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During  the  past  several  years,  one  thrust  cf  the  Organization  Development 
Research  Program*  has  been  tc  evaluate  the  effect!  veiuss  of  organization 
development  (OD)  techniques--especially  survey  feedback.  In  order  to 
facilitate  such  evaluations,  pre  and  post  measures  of  organizational 
functioning  and  several  kinds  of  criterion  data  (e.g.,  productivity, 
absenteeism)  have  been  collected.  Accumulating  evidence  indicates  that 
survey  feedback  has  been  employed  successfully  in  a number  of  work 
organizations  (Bowers,  1973;  Franklin,  1975;  Bowers  & Hausserft  1975) 
and  suggests  that  it  is  a potentially  powerful  OD  technique.  This  does 
not  imply,  however,  that  sr^vey  feedback  is  unconditionally  or  uniformly 
effective.  There  are  also  cases  where  survey  feedback  efforts  have 
produced,  at  best,  mixed  results.  Even  within  one  organization,  the  use 
of  this  OD  technique  may  be  associated  with  positive  change  in  some 
work  groups  and  negligible  or  negative  change  in  other  groups.  Results 
such  as  these  indicate  that  the  effectiveness  of  an  OD  technique  is  not 
determined  solely  by  elements  inherent  to  the  technique  itself.  Its 
relative  effectiveness  is  also  likely  to  be  influenced  by  variations  in 
how  the  basic  technique  is  implemented  (Klein,  et  al . , 1971). 


★ 

The  Organization  Development  Research  Program,  a part  of  the  Institute 
for  Social  Research,  is  headed  by  Dr.  David  6.  Bowers.  The  program 
previously  called  the  Business,  Industry,  and  Government  Program,  was 
formed  In  1970. 


Two  essential  elements  in  survey  feedback--problem-i denti  f ication  and 
problem-sol ving— are  implemented  thr-cgh  work  group  meetings.  The 
success  or  failure  of  survey  feedback  hingers,  at  least  in  part,  then,  on 
what  transpires  during  these  meetings.  The  fact  that  the  process  of 
group  meetings  may  vary  widely--even  when  general  guidelines  are  proviued-- 
points  to  the  desirability  of  documenting  in  some  detail  what  occurs 
during  the  meetings  themselves.  Such  documentation  would  make  it  possible 
to  investigate  the  effects  various  styles  of  implementing  survey  feedback 
have  on  the  success  of  the  feedback  effort.  Based  on  these  findings, 
specific  training  objectives  and  programs  could  be  developed  for  consultants 
and  managers  planning  to  implement  the  change  technique.  In  addition, 
mechanisms  for  providing  intermediate  "evaluations"  could  be  built  in. 

An  initial  effort  was  made  in  the  present  study  to  develop  and  test 
a documentation  method  applicable  to  group  feedback  meetings.  Two  coding 
schemes  were  developed  and  applied  to  a sample  of  tape-recorded  group 
feedback  meetings.*  The  purpose  of  this  report  is  to  describe  the  schemes 
and  their  reliability  and  tc  test,  in  an  exploratory  manner,  some  potential 
uses  of  such  schemes. 


While  there  were  many  possible  data  collection  methods  (o. g. , observation, 
questionnaires),  audio  tape  recordings  of  meetings,  was  chosen.  This 
approach  offered  several  advantages:  (1)  All  verbal  "raw"  data  would 

remain  in  tact.  The  data  could  then  be  analyzed  at  a later  time  in  an> 
number  of  ways.  That  is,  later  analysis  would  not  be  overly  constrained 
by  the  initial  data  collection  method.  (2)  Tape-recording  group  meetings 
required  little  time  from  the  clients  for  raw  data  collection.  In  develop- 
ment efforts  time  required  may  be  a crucial  factor.  (3)  While  group  members 
might  be  aware  of  the  tape-recorder  during  meetings,  the  recorder  would 
probably  be  less  intrusive  than  a trained  observer.  (4)  Some  variation  in 
data  collection  methods  is  desirable  in  itself  in  the  sense  that  different 
people's  perceptions  could  be  collected  in  different  ways.  Audio  recordings 
were  a contrast  to  the  survey  and  interview  metnod.  most  often  used 
in  our  development  efforts. 


Sample  and  Taping  Procedure 


The  data  used  in  this  study  were  collected  during  an  OD  effort 
which  began  in  December,  1972  in  a large  business  firm.  Two  departments, 
employing  324  persons,  were  the  focus  of  the  change  effort.  In  these  two 
departments  there  were  a total  of  33  work  groups*  and  each  work  group  had 
numerous  (N  > 8)  feedback  meetings  over  a period  of  several  months.  The 
sample  consists  of  a subset  of  tnese  meetings  which  were  tape-recorded. 

At  the  outset  of  the  meetings,  the  internal  consultant  requested 
permission  from  the  group  to  tape  the  meetings.  Very  little  resistance 
to  the  taping  was  expressed  and  no  work  group  refused  to  be  taped.  To 
provide  some  flexibility  concerning  what  would  be  taped  and  under  what 
conditions,  work  group  members  were  told  that  they  could  have  the  tape 
recorder  turned  off  at  any  time.  All  tapes  were  regarded  as  confidential; 
no  one  in  the  company  other  than  the  internal  consultants  had  access  to  them. 

For  the  purpose  of  testing  the  coding  schemes,  only  the  first  two 
meetings  were  included  in  the  present  sample.  Due  to  some  mechanical 
difficulties  in  the  taping,  the  tapes  from  some  of  these  early  meetings 

t 

were  not  useable.  The  final  sample  included  at  Teast  ' meeting  for  26 

1 

work  groups.  Nineteen  (19)  first  meetings  ano  eighteen  (18)  second 
meetings  were  successfully  taped. 

Before  turning  to  the  coding  schemes  and  proce  ire>  applied  to  these 
meetings,  a few  words  about  the  nature  of  these  meetings  seems  in  order. 

All  of  the  group  feedback  meetings  had  certain  characteristics  in  common. 

A standardized  survey  had  been  administered  to  all  employees  in  the  two 
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A work  group  is  defined  as  a supervisor  and  his  or  her  immediate  subordinates. 
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departments.  The  summarized  survey  results  fed  back  to  each  work  group 
pertained  to  what  the  subordinates  of  that  particular  group  said  about 
their  supervisor,  their  peers,  the  organizational  climate,  etc.  Each 
supervisor  received  the  results  for  his  work  group  and,  after  reviewing 
the  data  with  a resource  person  (i.e.,  company  consultant),  shared  the 
results  with  subordinates  in  a series  of  meetings.  The  purpose  of  the 
meetings  was  to  discuss  the  results  and  to  identify  and  solve  problems 
indicated  by  the  data.  A resource  person  was  "assigned"  to  each  group  and 
attended  the  meetings  to  facilitate  the  understanding  and  utilization  of 
the  survey  data.  These,  then,  were  the  common  elements  in  the  survey 
feedback  meetings. 

The  Coding  Schemes 

Obviously,  tape-recorded  discussions  provide  a massive  amount  of 
information  which  needs  to  be  condensed  and  summarized  in  some  way  if  it 
is  to  be  meaningful.  To  accomplish  this  data  reduction  task,  two  coding 
schemes  were  developed.  One--the  Behavior  Classification  Scheme  (BCS) , 
defined  discrete  categories  of  behavior".  The  coders,  as  they  listened 
to  a meeting,  recorded  in  sequence  each  occurrence  of  each  behavior 
category.  This  type  of  "statement-by  statement"  coding  scheme  resembles 
the  classic  content  analysis  procedure  employed  by  Bales  since  the  late 
1940 1 s (Bales,  1947;  1950a;  1950b;  1955;  1958;  1970).  Bales’  interest 
has  been  in  the  study  of  interpersonal  and  small  group  behavior,  and  thus,, 
his  methods  and  behavior  categories  were  very  relevant  to  the  task  at 
hand.  Coding  schemes  which  have  ceen  applied  to  classroom  interactions 
(Massialas,  et  al.,  1970;  Amidon  & Horugh,  1967)  and  problem-solving 
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discussions  (Mann  & Morris,  undated)  also  provided  content  and  structural 
guidelines  or  developing  the  Behavior  Classification  Scheme. 

The  strength  of  a scheme  like  the  BCS^  lies  in  the  precise,  concrete 
definitions  of  coding  categories  that  usually  accompany  them.  The  impor- 
tance of  providing  precise  definitions  of  categories  stems  from  the 
difficulty  of  the  coding  task.  Coders  must  separate  an  ongoing  stream  of 
interaction  into  discrete  "coding  units"  and  simultaneously  select  the 
appropriate  "label"  for  each  unit.  If  the  categories  are  not  clearly 
defined,  the  coders'  task  quickly  deteriorates  into  a random,  hit-and-miss 
operation.  The  need  for  preciseness  leads  to  an  emphasis  on  "behaviors" 
since  it  is  more  difficult  to  define  attitudes,  motivations,  and  feelings 
in  terms  of  discrete  statements.  These  non-behavioral  dimensions  or 
meetings  and  interactions  are  often  more  pervasive  and  diffuse.  Thus, 
the  BCS  provides  a concise  framework  for  summarizing  the  behaviors  occurring 
during  a feedback  meeting  meeting. 

The  second  coding  scheme--the  Summary  Rating  Scheme  (SRS)--incl uded 
several  survey-like  questions  which  the  coders  answered  after  listening  to 
an  entire  meeting.  In  this  case,  then,  a coding  unit  consisted  of  an 
entire  meeting.  Rating  schemes  like  these  have  been  employed  by  on-site 
observers  (Jenkins,  et  al . , 1975)  as  well  as  by  off-site  coders  (Alderfer 
& Lodahl , 1971;  Berg,  1972).  Schemes  like  the  SRS  are  quite  flexible  in 
terms  of  the  numbers  and  kinds  of  dimensions  that  can  be  tapped.  The 
coding  task  is  relatively  simple,  although  coder  reliability  and  validity 
is  an  issue  with  this  scheme  as  much  as  with  the  BCS. 
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Many  of  the  questions  Included  in  the  SRS  were  drawn  from  Bowers' 
conceptualization  of  consultant  roles  and  consultant  debriefing  interview 
schedules  employed  in  an  earlier  OD  effort  (Bowers,  undated).  In  addition, 
some  questions  were  written  to  assess  characteristics  comparable  to 
those  measured  by  the  BCS  so  that  relationships  between  the  two  schemes 
could  be  explored. 

Because  the  two  schemes  differ  substantially  in  their  content  and 
format,  each  will  be  described  separately.  The  issue  of  coder  reliability 
is  also  addressed  separately  for  each  scheme  since  the  appropriate 
techniques  for  assessing  reliability  vary  according  to  the  format  of  the 
coding  scheme. 

THE  SUMMARY  RATING  SCHEME 

The  Summary  Rating  Scheme  (SRS)  included  54  questions  that  focused 
on  four  aspects  of  the  meetings:  the  role  of  the  resource  person,  the 

role  of  the  supervisor,  the  role  of  group  members,  and  the  quality  and 
nature  of  the  group  discussion  as  a whole.  Most  questions  were  answered 
on  a 5-point  extent  scale.  The  entire  SRS  is  included  in  Appendix  A. 

A sample  item  and  the  rating  scale  are  presented  below: 

Q43.  SILENCE:  To  what  extent  were  there  long  periods  of  silence 

during  the  meeting? 

1.  To  a very  littk  extent 

2.  To  a little  extent 

3.  To  some  extent 

4.  To  a great  extent 

5.  To  a very  great  extent 
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The  questions  in  the  SRS^  were  developed  in  the  context  of  some  _a 
priori  assumptions  regarding  the  appropriate  roles  for  the  various  people. 
For  example,  the  role  of  the  resource  person  (RP)  was  seen  as  one  of 
facilitating  the  discussion  without  leading  the  meeting.  Thus,  questions 
about  the  resource  person  focused  on  the  ways  in  which  this  facilitating 
role  was  accomplished,  the  resource  person's  activity  level,  the  clarity 
of  the  resource  person's  statements,  and  the  response  of  the  group  to  the 
resource  person's  inputs.  Three  alternative  facilitator  styles  were 
measured.  These  styles  are  referred  to  as  information  resource,  catalyst, 
and  interpersonal  confronter. 

The  extent  to  which  the  resource  person  acted  as  an  information 
resource  was  measured  by  a single,  straightforward  item.  This  style  was 
defined  for  the  coders  as  one  in  which  the  resource  person  provides 
information  regarding  the  meaning  of  the  group's  survey  results,  the  goals 
of  the  Survey-Guided  Development  effort,  and  activities  that  might  take 
place  as  a part  of  the  effort.  The  extent  to  which  the  RP  acted  as  a 
catalyst  was  defined  as  the  extent  to  which  the  RP  made  inputs  designed 
to  promote  indirectly  the  problem-solving  process.  This  style  was  measured 
by  two  items— one  assessing  whether  the  RP  affected  the  process  of  the 
meeting,  and  one  regarding  the  extent  to  which  the  RP  stimulated  action 
steps.  The  extent  to  which  the  RP  acted  as  an  interpersonal  confronter  was 
assessed  by  three  questions.  Two  of  these  questions  measured  the  extent 
to  which  the  RP  made  statements  about  how  group  members  related  to  each 
other  and  actively  confronted  them.  One  additional  item  assesses  the 
extent  to  which  the  RP  intervened  in  emotional  encounters  between  group 
members. 
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The  RP's  overall  activity  level  was  measured  by  items  referring  to 
dominating  and  directive  behavior,  the  extent  to  which  the  RP  made  more 
inputs  than  the  group  desired,  and  a reversed  item  that  measured  the 
extent  to  which  the  RP  remained  silent  except  to  answer  questions.  The 
degree  of  opposition  of  group  members  to  the  RP's  interventions  was  also 
assessed. 

Two  aspects  of  the  supervisor's  role  as  group  leader  were  of  interest: 

(1)  the  extent  to  which  the  supervisor  exhibited  a variety  of  leadership 
behaviors  and  was  competent  in  leading  the  discussion,  and  (2)  the  extent 
to  which  the  supervisor  prevented  or  suppressed  participation  by  group 
members. 

The  role  played  by  group  members  was  assessed  for  all  subordinates  as 
a group  rather  than  for  individual  people.  The  variables  of  interest  were: 

(1)  the  extent  to  which  several  group  members  actively  participated  in 
the  discussion,  and  (2)  the  extent  to  which  a few  dominated  the  discussion. 

Finally,  there  were  several  questions  that  focused  on  how  the  discussion, 
as  a whole,  progressed.  The  areas  tapped  were  varied  and  include  the  general 
types  of  problems  dealt  with,  how  productive  and  systematic  the  meeting  was, 
the  degree  of  frustration,  defensiveness,  resistance,  and  commitment 
exhibited,  the  extent  to  which  people  were  listening  to  each  other,  and 
the  extent  to  which  conflicting  messages  were  being  communicated. 

The  coding  procedure  involved  listening  to  an  entire  tape  and  then 
answering  the  questions  with  reference  to  the  meeting  as  a whole.  The 
author  held  one  session  with  the  coders  to  train  them  in  using  the  SRS . 

During  the  session,  each  question  was  read  aloud,  paraphrased  by  the 
coders,  and  explained  in  more  detail  when  there  were  ambiguities. 
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Sample  portions  of  tapes  were  played  after  which  the  coders  and  the  author 
answered  independently  all  54  questions.  The  ratings  were  compared,  with 
the  investigator's  ratings  serving  as  the  standard.  There  were  only  minor 
discrepancies  in  ratings  and  these  were  discussed  and  resolved.  This 
training  session  lasted  about  three  hours.  It  was  decided  that  no  further 
formal  training  was  needed,  although  if  questions  regarding  the  scheme 
arose,  the  coders  were  asked  to  consult  with  the  investigator. 


Summary  Rating  Scheme:  Coder  Reliability  and  Validity 

A major  purpose  of  this  investigation  was  to  develop  and  test  methods 
of  assessing  what  ranspires  during  survey  feedback  meetings.  The 
methodology  chosen  in  this  case  was  behavior  coding  of  audio  tapes.  Central 
issues  affecting  the  utility  of  this  method  are  (1)  the  extent,  to  which 
coders  rate  the  same  behaviors  in  the  same  way,  and  (2)  the  extent  to  which 
coders  rate  behaviors  correctly  (i.e.,  the  way  an  expert  judge  would  rate 
them).  These  issues  are  essentially  issues  of  reliability  and  validity: 

How  confident  may  one  be  that  the  ratings  reflect  what  actually  occurred 
during  the  meeting  as  opposed  to  reflecting  the  individual  orientations 
of  the  coders? 

The  first  step  in  answering  this  question  usually  involves  verifying 
the  units  that  were  coded.  Unit  reliability  is  not  an  issue  in  this  case, 
however,  because  the  Summary  Rating  Scheme  defined  a unit  as  the  audio 
tape  of  a meeting.  Thus  there  was,  for  all  practical  purposes,  zero 
probability  of  error  in  unit  definition. 
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The  second  step  is  to  assess  the  extent  to  which  coders'  ratings  are 
congruent  with  each  other  (reliability)  and  with  a "standard"  (validity). 

Ir.  this  case,  the  investigator  served  as  the  reliability  check  and  the 
standard  simultaneously.  ..  subset  of  tapes  were  coded  independently  by 
the  investigator  as  well  as  being  rated  by  cne  other  coder.  The  task  then 
was  to  assess  the  extent  to  which  the  ratings  of  the  coder  and  the  investi- 
gator were  congruent. 

The  two  most  common  tests  of  inter-coder  agreement  are  the  correlation 
coefficient  and  a simple  percentage  of  agreement  coefficient.  Each  of  these 
methods,  however,  has  weaknesses.  A correlation  coefficient  is  a measure 
of  association  rather  than  agreement.  Thus,  one  coder  might  give  a 
series  of  dimensions  ratings  of  1,  2,  2,  3,  3,  while  the  check  coder 
gives  ratings  of  3,  4,  4,  5,  5.  In  this  example  dimensions  are  rated 
relatively  higher  or  lower  to  the  same  extent  by  both  coders.  Thus,  the 
correlation  coefficient  would  be  +1.0,  which  represents  perfect  association, 
even  though  the  two  coders  are  not  giving  units  the  same  ratings.  The 
problem  wi  percentage  agreement  statistic  is  that  it  assesses  coder 
agreement  without  taking  account  of  tho  fact  that  some  degree  of  congruence 
is  expected  by  n'ere  chance  alone.  Thus,  what  is  needed  is  a test  of 
agreement  which  assesses  the  degree  of  congruence  greater  than  that 
expected  by  chance.  Cohen's  weighted  kappa  (kw)  (Cohen,  1968)  is  one 
such  test  and  was  used  to  assess  coder  agreement  with  the  standard  for  the 
SRS.  An  additional  feature  of  Cohen's  test  is  that  partial  credit  may  be 
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given  for  two  close  but  non-identical  ratings  through  assigning  weights 
to  the  off-diagonal  (diagonal  = perfect  agreement)  cells.  The  formula 
for  weighted  kappa  is: 


k 


w 


Zwij  foij 


„w . . 

r,  u 


f . . 
cij 


wmax  N"  iwij  fcij 


where : 


I = sum 


wmax  = the  maximum  weight 

wij  = the  weight  assigned  to  a given  cell 

^oij  = the  jbserved  frequency  in  a jiven  cell 

^cij  = the  frequency  expected  by  chance  in  a given 
cell  = row  total /N  X column  total 
N - total  frequency 


The  value  of  may  range  from  -1  to  +1;  however,  maximum  values  require 

having  identical  row  and  column  totals.  In  practice,  then,  the  maximum 

value  of  k.  is  somewhat  less  than  1. 
w 

In  the  present  study,  partial  credit  (2/3  credit)  was  given  for 
ratings  that  were  discrepant  by  1 scale  point.  No  credit  was  given  when 
discrepancies  between  the  coder's  and  the  Investigator's  ratings  were 
greater  than  1 :cale  point.  Thus,  the  following  weighting  scheme  was 
applied^ 

Investigator  Ratings  (5-point  scale) 
1 2 3 4 5 

1 
2 

Coder  Ratings 

(5-point  scale)  3 

4 

5 


perfect  agreement 
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Seventeen  tapes  were  coded  d y both  the  investigator  and  a coder.  It  was 
necessary  to  compute  global  reliabilities  rather  than  computing  a k for 
each  question  since  the  number  of  tapes  which  were  coded  by  both  was  small 
(17).  Thus,  the  reliabilities  of  sets  of  questions  were  assessed  without 
regard  to  the  content  of  the  specific  items.  The  k coefficients  reflect, 

rl 

therefore,  inter-rater  agreement  in  general  rather  than  coder  reliability  on 
particular  questions. 

For  the  purpose  of  computing  k , the  54  questions  were  put  into  three 

V? 

a priori  categories: 

Category  I:  Questions  that  required  mental  summing  and  averaging 

of  observable  behaviors.  (N  - 27  questions) 

Category  II:  Questions  that  required  the  coders  to  make  judgements 

about  the  quality  of  a behavior  or  contribution. 

(N  = 21  questions) 

Category  III:  Questions  that  required  the  coder  to  make  inferences 

about  the  attitudes  or  desires  of  group  participants. 

(N  = 6 questions) 

Questions  in  Category  I were  the  most  straightforward  and  objective  questions, 
while  questions  in  Category  III  were  more  difficult  and  subjective  in 
nature.  Based  cn  the  assumption  that  coders  are  likely  to  view  observable 
behaviors  more  similarly  than  they  interpret  attitudes  and  desires,  it 
was  predicted  that  Category  I would  have  the  highest  k value  and  Category 
III  would  have  the  lowest.  The  category  into  which  each  question  was 
placed  is  indicated  in  Appendix  B.  In  order  to  give  the  reader  a feel  for 
the  three  categories,  however,  sample  items  from  each  category  are  lasted 


below: 
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Sample  Items  -Frrm  each  A Priori  Category 


Category  I : 

Q2. 

To  what  extent  did  the  resource  person  make 
statements  about  how  group  members  were  relating 
to  each  other? 

Q9. 

To  what  extent  did  the  resource  person  remain 
silent  except  when  responding  to  questions 
directed  toward  her/him? 

Category  1 1 * 

Ql. 

To  what  extent  did  the  resource  person  make 
comments  which  affected  the  process  of  the 
discussi on? 

Q8. 

To  what  extent  were  the  resource  person's 
statements  easy  to  understand?  (i.e.,  clarity 
in  meaning) 

Category  III: 

Q4. 

To  what  extent  did  the  resource  person  make  more 
inputs  than  the  group  seemed  to  want? 

Q16. 

To  what  extent  were  double  messages  being  sent? 
That  is,  to  what  extent  were  there  discrepancies 
between  a participants  verbal  message  and  his 
emotional  message? 

A weighted  kappa  coefficient  was  calculated  separately  for  each  category. 

Table  1 presents  the  results.  The  k coefficients  ranged  from  .54  to 

w 

.43.  As  was  predicted.  Category  I had  the  highest  reliability  and  Category 

III  the  lowest  although  the  variation  was  not  substantial.  These  reliabili  c.y 

coefficients  are  in  line  with  those  obtained  by  other  researchers  using  k . 

w 

Jenkins,  at  al.,  (1975)  when  computing  the  inter-rater  reliability  on 
sever. a1  job  and  personality  characteristics,  got  k.  coefficients  ranging 
fron  -.67  to  -.26,  with  27  of  59  coefficients  being  smaller  than  | . 33 | . 

Thus,  the  SRS  is  judged  to  be  acceptable,  reliable,  and  valid. 
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Table  1 

WEIGHTED  KAPPA  (k.„)  COEFFICIENTS  FOR  THREE  A PRIORI  CATEGORIES 

Yt  — * “ 

OF  THE  SUBJECTIVE  CODER  ANALYSIS: 

RELIABILITY  AND  VALIDITY  ESTIMATES 


Category  1^ 

I .54 

II  .49 


III 


.43 


lb 


Summary  Rating  Scheme:  Index  Creation 

As  stated  previously,  SRS  items  focused  on  selected  aspects  of  the 
roles  played  by  the  resource  person,  supervisor,  and  group  members,  and 
on  the  nature  of  the  group  discussion  as  a whole.  This  framework  influenced 
the  index  creation  process.  In  addition,  however,  a hierarchical  cluster 
analysis  was  performed  using  the  data  from  one  meeting  per  group  (N=26).* 
Thirteen  (13)  indices,  including  between  2 and  6 items  each,  were 
created.  These  indices  and  their  component  items  are  listed  in  Table  2 . 

Twelve  (out  of  the  54)  SRS  items  were  not  included  in  any  index  out  were 
retained  as  single  items.  These  items  are  also  listed  in  Table  2 . 

Alpha  coefficients,  a measure  of  internal  consistency  or  scale  reliability, 
were  computed  for  each  of  these  indices.  The  results  are  shown  in  Table  3. 

The  alpha's  ranged  from  .63  to  .94.  Thus,  the  internal  consistency 
of  the  indices  is  quite  acceptable. 

Table  4 shows  the  intercorrelations  among  the  -indices.  Some  moderate 
correlations  were  expected  because  all  the  SRS  items  shared  methods  variance 
and  because  the  sets  of  behaviors  reflected  by  the  indices  are  probably 
related  to  some  degree  "in  reality."  At  the  same  time,  however,  very  high 
intercorrelations  would  indicate  that  the  indices  measured  the  same  or  very 
similar  concepts.  As  Table  4 shows,  the  correlations  ranged  from  .00  to 
,77  . The  median  intercorrelation  was  .20.  Thus,  the  correlations 
varied  substantially  in  size.  No  inter-scale  correlation  was  larger--and 

■fe  " ' 

If  a group  had  data  for  two  meetings,  data  from  the  first  meeting  were  used. 
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Table  2 

SRS  INDICES  AND  COMPONENT  ITEMS 


Index 


Component  Item,,  - "To  what  extent.,. 


SRS 1 : RP  Makes  Impact 


SRS2:  RP  Overly  Active/Directive 


SRS3:  RP  Confronts  Group  Members 


SRS4:  RP  Opposed  by  Group 


SRS5 : Supervisory  Leadership 


Q 1 . . .did  the  RP  make  comments  which  affected 
the  process  of  the  discussion?" 

Q6...was  the  RP  active  in  making  diagnostic 
comments  and/or  stimulating  action  steps 

Q4...did  the  RP  make  more  inputs  than  the 
group  seemed  to  want?" 

Q9 ...did  the  RP  remain  silent  except  when 
responding  to  questions  directed 
toward  him/her?"  (Reversed  item) 

Q5Q...did  the  RP  dominate  the  discussion?" 

Q53...did  the  RP  actively  direct  the 
discussion?" 

Q2 . . .did  the  RP  make  statements  about  how 
group  members  were  relating  to  each 
other?" 

Q7..,did  the  RP  actively  confront  group 
members?" 

Q10. . .did  conflict  exist  between  the  RP?" 

Qll...When  the  RP  intervened,  to  what 

extent  was  encountered  in  response 
to  the  intervention?" 

Q13.,.was  the  RP  attacked  by  the  group  for 
suggesting  changes';" 

Q15...was  the  supervisor  competent  in 
leading  the  discussi onr" 

Q43 . . .did  the  supervisor  seem  open  to  the 
opinions  and  ideas  of  his/her 
subordinates?" 

Q44..,di^  the  supervisor  encourage  group 
members  to  work  together  as  a team?" 

Q45...did  the  supervisor  help  to  remove 
roadblocks  to  solving  problems?" 

Q46...did  the  supervisor  emphasize  goals 
(work,  change  objectives,  etc.)?" 

Q51 ...did  the  supervisor  actively  direct 
the  discussion?" 


Index 


S RS 6 : Sup.  Prevents  Group  Discussion 


SRS7 : Group  Participation 


SRS8:  Group  Not  Defensive 


SRS9:  Productive  Meeting 


S RS 1 0 : Discuss i on  Unsystematic 


Component  Items  - "To  what  extent... 


Q47...did  the  supervisor  suppt-ess  group 

discussion  through  his/her  attitude 
or  actions?" 

Q48...did  the  supervisor  dominate  the 
discussion?" 

Q38...did  group  members  participate  in 
the  discussion?1' 

Q39..,did  group  members  interact  with  each 
other  (rather  than  merely  responding 
to  the  supervisor)?" 

Q40...were  group  members  willing  to  talk 
about  problems?" 

Q52 . . .did  group  members  actively  direct 
the  discussion?" 

Q17...were  members  (including  the  supervisor) 
honest  and  candid  about  themselves?" 

Q 1 8 . . .did  individuals  take  an  "I'm  the-one- 
who-has-to-change"  attitude?" 

Q30...were  maintenance  inputs  provided  by 
the  RP,  supervisor,  and  group 
members?" 

Q31...were  content  inputs  provided?" 

Q32...were  real  problems  identified?" 

Q33...were  there  attempts  to  solve  problems 
which  were  identified?" 

034... were  problems  actually  solved?" 

Q37...v.(as  the  group  interaction  of  "high 
qual ity?" 

Q2Q.„.was  the  problem-solving  sequence 
(the  content  inputs)  followed 
followed  systematically?"  (Reversed 
i tern) 

Q21.,.did  the  discussion  get  side-tracked 
on  to  inconsequential  topics?" 
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SRS11 : 


Index 


Component  Items  - "To  what  extent... 


Change  Objectives  Opposed 


Q26...were  change  objectives  of  the 

program  clearly  explained  to  group 
members?" 


Q27...was  there  disagreement  on  change 
objectives?" 

Q28...was  there  resistance  to  the  change 
objectives?" 


S RS 1 2 : Problems  Out:ide  Control 


SRS13:  Group  Not  Listening 


Q19...was  a "change-the-other-guy"  attitude 
in  evidence?" 

Q22d. . . (were)  problems  related  to  constraints 
created  by  the  si tuation?" 

Q35...were  the  problems  discussed  within 
the  control  of  the  work  group  and 
supervisor?"  (Reversed  item) 

Q36...were  the  problems  discussed  outside 
the  control  of  the  work  group  and 
supervisor?" 

Q 14... did  group  members  (including  the 

supervisor)  misunderstand  each  other?" 

Q42..,were  people  "battling"  for  air-time?" 
i.e.,  to  what  extent  were  people 
interrupting  each  other  and  talking 
all  at  once  in  order  to  get  their 
opinions  voiced?" 


Single  Items  - "To  what  patent... 


Q3,..did  the  group  request  inputs  from 
the  RP?" 

Q5,..did  the  resource  person  act  as  an 
information  resource?" 

Q8...were  the  RP's  statements  easy  to 
understand?" 

Q1 2 . . .did  the  RP  intervene  in  emotional 
encounters  between  others  at  the 
meeting?" 

Q16...were  double  messages  being  sent? 

That  is,  to  what  extent  were  there 
discrepancies  between  a participant’s 
verbal  message  and  his  emotional 
message?" 
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Single  Ite.is  - "To  what  extent... 


Q50...did  a few  group  members  dominate 
the  discussion?" 

Q22a. . . (were)  problems  related  to  feelings 
or  affect  or  values?" 

Q22b...(were  problems  related  to  the  lack, 
or  inaccuracy,  of  information?" 

Q22c. . . (were)  problems  related  to  the  lack 
of  needed  skills?" 

Q25...was  there  consensus  on  and  commitment 
to  the  solutions  advanced?" 

Q29...how  much  frustration  was  in  evidence?" 

Q41...were  there  long  periods  of  silence 
during  the  meeting?" 


C.U 


Table  3 

ALPHA  COEFFICIENTS  FOR  SRS  INDICES 

Items 


#1 : RP/Makes  impact  2 

#2:  RP/overly  active/directive  4 

#3:  RP/confronts  group  members  2 

#4:  RP/opposed  by  group  3 

#5:  Sup  leadership  6 

#6:  Sup  prevents  group  discussion  2 

#7:  Group  participates  4 

#8:  Gropp  not  self-protective  2 

#9:  Productive  meeting  6 

#10:  Discussion  unsystematic  2 

#11:  Change  objectives  opposed  3 

#12:  Problems  outside  control  4 

#13:  Group  not  listening  2 


A1  pha 
.88 
.94 
.86 
.63 
.80 
.70 
.89 
.69 
.89 
.73 
.83 
.83 
.68 
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Table  4 

INTERCORRELATION’S  OF  SRS  IN DiCtS 


SRS1  = RP  Makes  Impact 

2 = RP  Overly  Acti ve/Di r«*~tive 

3 = RP  Confronts  Group  Members 

4 = RP  Opposed  b”  Groups 

5 = Supervisory  Leadership 

6 = Sup.  Prevents  Group  Discussion 

7 = Group  Participation 

8 = Group  Not  Defensive 

9 = Productive  Meeting 

10  = Discussion  Unsystematic 

11  = Change  Objectives  Opposed 

12  = Problems  Outside  Control 

13  = Group  Not  Listening 


most  were  substantially  smaller--than  the  alphas  for  the  respective  scales, 
however.  This  is  a sign  of  good  discriminant  validity--that  is,  that  the 
SRS  indices  measured  several  different  dimensions  of  the  meeting. 

THE  BEHAVIOR  CLASSIFICATION  SCHEME 

The  Behavior  Classification  Scheme  (BCS) , the  second  coding  scheme 
developed  in  this  study,  was  used  to  classify  the  verbal  interactions  during 
survey  feedback  meetings.  The  interactions  were  coded  directly  from  the 
audio  tapes.  Coders  were  instructed  to  listen  to  the  entire  tape,  apply 
the  Summary  Rating  Scheme,  and  then  go  through  the  tape  again  using  the 
BCS.  This  sequence  was  adopted  in  order  to  give  the  coders  some  familiarity 
with  the  general  flow  of  die  meeting  before  they  began  their  behavior-by- 
behavior coding  of  the  often  complex,  fast-moving  verbal  interactions. 

The  entire  coding  scheme  in  its  original  form  is  included  in  Appendix 
A.  A summary  of  the  original  categories  and  sub-categories  in  the  scheme 
is  presented  in  Table  5.  The  categories  bear  a marked  resemblance  to 
the  functions  or  roles  that  have  been  described  as  important  aspects  of 
group  process  by  many  researchers  and  practitioners.  There  were  37 
basic  categories:  16  were  task-related,  16  were  maintenance  related,  and 
5 were  referred  to  as  miscellaneous  inputs.  Two  basic  categories  were 
sub-divided  into  more  specific  categories,  making  a total  of  42.  All 
42  categories  were  defined  in  terms  of  the  problem-solving  behavior  of 
any  speaker;  no  single  category  was  restricted  to,  for  example,  resource 
person  statements  or  group  member  statements. 
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A coding  unit  in  the  BCS  was  defined  as  a problem-solving  input 
provided  by  a given  speaker  during  a survey  feedback  meeting.  A unit 
consisted  of  a single  and  complete  task,  maintenance  (i.e.,  process),  or 
miscellaneous  input  as  defined  by  the  behavior  categories,  regardless 
of  the  time  required  to  make  the  input.  In  addition,  every  time  the 
"speaker"  (resource  person,  supervisor,  group  member)  changed,  a new  unit 
was  coded. 

Categories  10,  15.  30,  31,  35,  and  50  to  53  were  "request"  categories 
that  is,  they  defined  information-seeking , question-asking  behaviors. 
Categories  20,  25,  40  to  44,  and  60  63  were  "provision"  categories 

paralleling  the  request  categories  in  content.  The  provision  categories, 
however,  describe  in  formation -giving,  question-answering  behaviors. 
Categories  70  to  79  Were  considered  functional  inputs  that  would  help  to 
maintain  or  promote  constructive  discussion.  Categories  82  to  87  were 
considered  dysfunctional  inputs;  that  is,  they  were  described  as  inputs 
that  might  hinder  group  discussion.  The  behaviors  described  by  categories 
95  to  98  were  also  related  to  maintaining  group  discussion,  but  were  not 
classified  as  functional  or  dysfunctional  inputs.  Finally,  category  99 
was  used  to  indicate  that  the  coders  could  not  hear  what  was  being  said 
and  was  considered  the  equival’rt  of  a missing  data  code  in,  for  example, 
survey  data. 

There  were,  in  addition,  5 notations  for  speakers: 

1 = resource  person 

2 = supervisor 

3 = work  group  member 

4 = general  response 

9 = unidentifiable  speaker  (missing  data  equivalent) 


MISC.  INPUTS  MAINTENANCE  INPUTS  CONTENT  INPUTS 


Table  5 

SUMMARY  OF  CATEGORIES  IN  THE  BEHAVIOR  CLASSIFICATION  SYSTEM 
TYPE  OF  INPUT 


REQUEST 


PROVISION 


TO.  Exposition 

15.  Progress  reporting 

30.  Problem  definition  and 
cl arifi cation 

31.  Problem  in  whose  control 


35.  Setting  priorities 

50.  Identifying  solutions 

51.  Evaluating  solutions 

52.  Active  choice  of  solutions 

53.  Implementing  solutions 


20.  Exposition 

25.  Progress  reporting 

40.  Problem  definition  and 
clarification 

41.  Problem  within  group's 
control 

42.  Problem  outside  group's 
control 

43.  Task-relatr.^.  problems 

44.  Interpersonal  conflict 
problem 

43.  Setting  priorities 

60.  Identifying  solutions 

61.  Evaluating  solutions 

62.  Active  choice  of  solutions 

63.  Implementing  solutions 


FUNCTIONAL 


DYSFUNCTIONAL 


70.  Encouragement  of  participation 

71.  Rein forcement/acceptance 

72.  Positive  perception 

73.  Agreement 

74.  Disagreement 

75.  Separation 

76.  Consensus  testing 

77.  Conflict  resolution 

78.  Summarizing 

79.  Process  comments/checLing 
accuracy 


82.  Negative  perception 

83.  Negative  response 

84.  Non-productive  response 

85.  Non-response  to  leads 

86.  Fragmented  discussion 

87.  Suppression 


95.  Seek i rig  approval 

96.  Evv.'ance  of  misunderstanding 

97.  Laughter 

98.  Miscellaneous 

99.  UnintelligiLle/NA 


00. 
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A.  Request  of  Task  Inputs 

10.  EXPOSITION;  The  speaker  requests  statements  which  provide 

general  information  about  or  reactions  to  (a)  the  development 
effort,  survey  methodology,  or  meaning  of  the  indices, 

(b)  the  purpose  of  the  data  feedback  session(s),  or 

(c)  the  score  on  an  index  or  item. 

15.  PROGRESS  REPORTING:  The  speaker  requests  statements  which 

provide  information  about  (a)  which  action  steps  have  been 
taken  to  solve  a problem  or  (b)  whether  the  action  steps 
taken  have  solved  the  problem  they  were  intended  to  solve. 

30.  PROBLEM  DEFINITION  AND  CLARIFICATION:  The  speaker  requests 
statements  which  (a)  identify  specific,  concrete  problems 
indicated  by  a particular  index  or  item  score,  (b)  clarify 
a previous  statement,  or  (c)  provide  a concrete  example  of 
a general  problem. 

31.  Problem  Within  Whose  Control:  The  speaker  requests 

statements  which  identify  the  problem  as  one  which 
that  particular  work  group  can  solve  or  as  one  which 
another  group  or  department  must  solve. 

35.  SETTING  PRIORITIES : The  speaker  requests  statements  which 

indicate  the  order  in  which  the  problems  defined  should  be 
solved. 

50.  IDENTIFYING  POSSIBLE  SOLUTIONS:  The  speaker  requests  state- 

ments which  identify  possible  solutions  to  a problem  in 
terms  of  the  concrete  steps  which  must  be  taken. 

51.  EVALUATING  PROPOSED  SOLUTIONS:  The  speaker  requests  statements 

"which  evaluate  the  feasibility,  attractiveness,  or  utility 

of  the  suggestions  for  solving  a problem. 

52.  ACTIVE  CHOICE  OF  SOLUTION:  The  speaker  requests  statements 

which  indicate  which  of  the  proposed  solutions  will  be 
implemented . 

5...  IMPLEMENTING  THE  SOLUTION:  The  speaker  requests  statements 

which  identify  a particular  person  as  responsible  for 
taking  specific  action  steps. 
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B,  PROVISION  OF  CONTENT  INPUTS 

20.  EXPOSITION:  The  speaker  makes  statements  which  provide 

general  information  about  or  reactions  to  (a)  the  development 
effort,  survey  methodology,  or  the  meaning  of  indices, 

(b)  the  purpose  of  the  data  feedback  session(s),  or  (c)  the 
score  on  an  index  or  item. 

25.  PROGRESS  REPORTING:  The  speaker  makes  statements  which  provide 
information  about  (a)  which  action  steps  have  been  taken  to 
solve  a problem  or  (b)  whether  the  action  steps  taken  have 
solved  che  problem  they  were  intended  to  solve. 

40.  PROBLEM  DEFINITION  AND  CLARIFICATION:  The  speaker  makes 

statements  which  (a)  identify  specific,  concrete  problems 
indicated  by  a particular  item  or  index  score,  (b)  clarify 
a previous  statement,  or  (c)  provide  a concrete  example 
of  a general  problem. 

41 . Problem  Within  Group's  Control : The  speaker  makes 
statements  which  identify  the  problem  as  one  which 
that  particular  work  group  can  solve. 

42.  Problem  Outside  the  Group's  Control:  Speaker  makes 
statements  which  identify  the  problem  as  one  which 
someone  outside  that  particular  work  group  must 
solve. 

43.  Task-Related  Problem:  The  speaker  makes  statements 
indicating  that  the  problem  is  a task-related  one 
as  opposed  to  one  centering  around  interpersonal 
confl  icts . 

44 . Problem  Centers  Around  Interpersonal  Conflict:  The 
speaker  makes  statements  indicating  that  the  problem 
centers  around  interpersonal  conflict  as  opposed  to 
being  a very  task-related  problem. 

45.  SETTING  PRIORITIES:  The  speaker  makes  statements  which  indicate 
the  order  in  which  the  problems  defined  should  be  solved. 

60,  IDENTIFYING  POSSIBLE  SOLUTIONS:  The  speaker  makes  statements 
which  identify  possible  solutions  to  a problem  in  terms  of  the 
concrete  steps  which  must  be  taken 

61.  EVALUATING  PROPOSED  SOLUTIONS:  The  speaker  makes  statements 
which  evaluate  the  feasibility,  attractiveness,  or  utility 
of  the  suggestions  for  solving  a problem. 
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62,  ACTIVE  CHOICE  OF  SOLUTION:  The  speaker  makes  statements  which 
Indicate  which  of  the  proposed  solutions  will  be  Implemented. 

63.  IMPLEMENTING  THE  SOLUTION:  The  speaker  makes  statements  which 
identify  a particular  person  as  responsible  for  taking 
specific  action  steps. 


C.  PROVISION  OF  MAINTENANCE  J1PUTS 


Functional  Inputs: 

70.  ACTIVE  ENCOURAGEMENT  OF  PARTICIPATION:  The  speaker  encourages 

others  to  ask  questions , offer  opinions,  and  discuss  issues 

by  explicitly  Inviting  such  participation. 

71.  REINFORCEMENT/ACCEPTANCE:  The  speaker  makes  statements  which 
Indicate  that  the  individual  should  continue  his  behavior 
though  not  necessarily  Indicating  agreement  with  content. 

72.  POSITIVE  PERCEPTION  OF  OTHERS:  Speaker  makes  statements 
which  Indicate  a positive  view  of  some  other  person(s). 

Use  this  category  only  when  the  unit  is  not  coded  as  a 
content  input. 

73.  EXPRESSING  AGREEMENT : The  speaker  makes  statements  which 
clearly  indicate  agreement  with  a statement  or  Idea. 

74.  EXPRESSING  DISAGREEMENT : The  speaker  makes  statements 

which  Indicate  disagreement  with  an  idea  or  statement. 

75.  SEPARATING  IDEA-SEEKING  FROM  IDEA-EVALUATION:  The  speaker  makes 

statements  requesting  that  a problem  be  defined  or  suggestions 
for  solving  problems  be  presented  without  anyone  evaluating 
their  feasibility,  utility,  or  attractiveness. 

76.  CONSENSUS -TESTING:  The  speaker  requests  statements  Indicating 
tfie  degree  of  agreement  with  an  Issue  or  decision, 

77.  CONFLICT  RESOLUTION : The  speaker  makes  statements  which 
encourage  two  or  more  people  to  stop  disagreeing  with  each 
other  so  vehemently.  The  speaker's  statements  indicate  that 
he/she  Is  seeking  the  source  of  the  conflict  or  trying  to 
resolve  It,  not  just  trying  to  cool  It  out. 

78.  SUMMARIZING:  The  speaker  makes  statements  reviewing  the 
discussion.  The  speaker  Is  doing  more  than  paraphrasing 
another  speaker;  he/she  Is  also  Integrating  previous  discussion. 

79.  PROCESS  COMMENTS/CHECKINP  ACCURACY : The  speaker  makes  statements 
which  help  to  guide  the  discussion,  get  the  group  back  on  the 
subject,  keep  the  group  focused  on  the  data,  or  check  the 
accuracy  or  clarity  of  some  statement  (speaker's  own  or  someone 
else's). 


Dysfunctional  Inputs: 


82.  NEGATIVE  PERCEPTION  OF  OTHERS:  Speaker  makes  statements 
which  indicate  a negative  view  of  some  other  person (s ) . 

It  may  take  the  form  of  an  accusation.  Use  this  category 
only  when  the  unit  is  not  coded  as  a content  input. 

83.  NEGATIVE  RESPONSE:  The  speaker  indicates  an  inability  or 
unwillingness  to  respond  tc  a request  or  perform  a task. 

84.  NON-PRODUCTIVE  RESPONSE:  The  speaker  makes  irrelevant  or 

disruptive  statements. 

85.  NON-RESPONSE  TO  LEADS:  Period  of  silence  following  a question 

or  request,  ended  by  (1)  speaker  clarifying  lead,  or  (2) 

same  or  different  speaker  going  off  in  a different  direction. 
"Thinking  time"  of  short  duration  (5  seconds  or  so)  should 
not  be  coded  as  non-response.  This  category  is  trying  to 
pick  up  unwillingness  to  respond,  or  inability  to  respond 
because  of  the  nature  of  the  question  or  request.  Code 
speaker  as  "general  response",  unless  a specific  speaker 
was  addressed.  Then  code  the  speaker's  number  who  did  not 
respond 

86.  FRAGMENTED  DISCUSSION:  A period  which  cannot  be  categorized 

because  the  statements ) cannot  be  understood  or  cannot  be 
separated. 

87.  SUPPRESSION:  The  speaker  makes  statements  which  inhibit  or 
squasTi  discussion  by  indicating  that  certain  topics  are  not 
to  be  discussed  because  of  his/her  personal  views. 


MISCELLANEOUS  INPUTS 

95.  SEEKING  APPROVAL:  The  speaker  requests  statements  which  indicate 

that  his  behavior  is  acceptable  to  others. 

96.  EVIDENCE  OF  MISUNDERSTANDING:  The  speaker  calls  attention  to 

a misunderstanding.  (Checking  understanding  should  be  coded 
as  a process  comment). 

97.  LAUGHTER : Laughter  which  interrupts  the  flow  of  conversation. 

98.  MISCELLANEOUS : The  speaker  makes  statements  which  cannot  be 

classified  under  any  of  the  other  categories. 

99.  UNINTELLIGIBLE : A statement  cannot  be  understood  because 

it  is  inaudible  or  drowned  out  by  background  noise. 
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For  each  unit  identified  by  the  coders,  both  the  speaker  and  the  behavior 
code  notations  were  recorded.*  Tfe  voices  of  the  resource  person  and 
supervisor  were  identified  for  the  coders  at  the  start  of  each  tape  by 
the  present  investigator. 

Training  sessions  of  various  kinds  were  held  with  professional  coders 
at  the  University  of  Michigan's  Survey  Research  Center  over  a time  span 
of  four  weeks.  Four  coders  and  one  check  coder/ coding  coordinator  were 
involved.  The  present  investigator  also  served  at  times  as  a trainer  and 
check-coder.  The  training  itself  was  a two-step  process.  First  the 
investigator  and  the  project  coding  coordinator  worked  together  to  refine 
the  scheme.  During  this  time,  the  coordinator  became  very  familiar  both 
with  the  BCS  and  with  this  investigator's  definitions  and  interpretations 
of  the  categories.  Cne  sample  tape  was  coded  jointly  by  the  coordinator 
and  investigator,  and  portions  of  a second  tape  were  coded  independently. 
The  two  sets  of  codes  were  then  compared  and  disagreements  were  resolved. 
Second,  the  coders  assigned  to  the  project,  the  coordinator,  and  the 
coders.  Once  again,  the  scheme  was  discussed  in  detail,  a tape  was  coded 
jointly,  and  then  portions  of  other  tapes  were  coded  independently  and 
everyone's  ratings  compared.  When  coding  discrepancies  began  to  occur 
infrequently,  the  formal  training  was  terminated.  Coders  were  instructed 
to  go  to  either  the  coding  coordinator  or  the  research  Investigator  when 
questions  regarding  the  scheme  arose.  Close,  frequent  contact  (usually 
daily)  was  maintained  with  the  coders  throughout  the  time  tapes  were  being 
coded. 

*In  addition  to  a more  detailed  explanation  of  the  categories,  Appendix  A 
includes  examples  and  guidelines  for  coding  the  verbal  interactions. 
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Behavior  Classification  Scheme:  Coder  Reliability 

The  Behavior  Classification  Scheme  with  its  42  discrete  categories 
and  sub-categories,  was  a complex  scheme  to  apply  to  the  audio  tapes. 

First,  coders  had  to  make  decisions  concerning  where  one  coding  unit 
ended  and  another  began.  This  decision  was  simple  when  speakers  changed 
since  every  time  a new  speaker  began,  a new  unit  was  coded.  There  were 
also  times,  however,  when  the  same  person  spoke  for  a fair  length  of  time 
(e.g.,  15  minutes).  In  such  cases,  coders  were  instructed  to  use  the 
behavior  category  definitions  in  deciding  when  a problem-solving  input 
was  completed.  The  inputs  made  during  each  meeting  were  recorded  in 
sequence  rather  than  merely  keeping  frequency  counts  of  the  behaviors 
occurring  in  order  to  preserve  the  flow  of  the  discussion. 

In  order  to  check  the  raters'  consistency  in  defining  and  labelling 
units,  a fairly  rigorous  "check-coding"  procedure  was  established. 

Coders  were  instructed  to  write  down  the  key  parts  of  statements  in  addition 
to  the  unit  labels  for  two  units  out  of  every  sequence  of  21  units  coded. 
These  written  keys  made  it  possible  to  match  coded  units  with  the  original 
tape-recorded  interactions. 

The  coding  coordinator  served  as  the  standard  of  comparison  for  the 
BCS.  The  coders  applied  the  BCS_  to  20  tapes  in  this  sample--16  first 
meetings  and  4 second  meetings.  Portions  of  17  tapes  which  the  coders 
worked  through  were  also  coded  independently  by  the  coding  coordinator. 

For  each  check-coded  tape,  the  coordinator's  ratings  were  compared  to 
the  coder's  ratings  of  the  same  portion  of  the  meeting.  The  coder  and 
check-coder  met  to  discuss  their  ratings  and  reached  consensus  where 


discrepancies  were  present.  This  discussion  served  as  additional  training 
for  the  coders.  The  consensus  codes  were  recorded  but  were  not  used  in 
testing  reliability  since  the  goal  in  checking  the  reliability  was  to  see 
how  congruent  the  two  initial,  independent  ratings  were. 

The  number  of  units  coded  for  the  meetings  ranged  from  189  to  882 
units.  The  number  of  units  per  meeting  check -coded  {i.e.,  the  number  of 
units  per  tape  checked  by  the  coding  coordinator)  ranged  from  49  to  63 
units.  Thus,  portions  of  85%  of  the  tapes  in  the  sample  were  check-coded. 

In  terms  of  the  percentage  of  units  which  were  check-coded,  one  may  assume 
that  a minimum  of  7%  (49/882)  and  a maximum  of  33%  (63/189)  were  coded 
independently  by  two  people. 

When  the  two  sets  of  ratings  for  the  17  tapes  were  initially  displayed, 
it  was  apparent  that  some  refinement  and  condensing  of  the  coding  scheme 
was  needed.  Many  of  the  categories  were  used  very  infrequently  (namely, 
categories  15,  25,  31,  41  to  44,  35,  45,  61  to  63,  51  to  53,  74  to  78, 

82  to  85,  87,  and  96).  In  addition,  some  confusion  appeared  to  exist 
about  the  distinctions  among  some  categories.  For  example,  categories  71 
(reinforcement)  and  73  (agreement)  were  often  used  *nterchangeably--one 
rater  would  label  a unit  71,  while  the  other  rater  would  use  category  73. 
Thus,  the  coding  scheme  was  revised  by  combining  each  of  the  infrequently 
used  categories  with  other  related,  similar  categories  and  by  collapsing 
categories  that  were  used  interchangeably. 


MISC  i MAINTENANCE  I CONTENT  INPUTS 
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The  Behavior  Classification  System,  after  this  revision,  included 
twelve  (instead  of  42)  categories.  The  categories  were  as  follows: 


BEHAVIOR  CLASSIFICATION  SCHEME:  REVISED 

TYPE  OF  INPUT 


REQUEST 

PROVISION 

10.  Problem-identification: 
Includes  categories  10,  15, 
30,  31,  from  original  scheme 

20.  Problem-identification: 
Includes  categories  20,  25, 

40  to  44,  from  original  scheme 

50.  Problem  solution:  Includes 

categories  35,  50  to  53,  from 
original  scheme 

_| 

60.  Problem  solution:  Includes 

categories  45,  60  to  63,  from 
original  scheme 

FUNCTIONAL 

DYSFUNCTIONAL 

71.  Reinforcement : Includes 

categories  70,  71,  73,  from 
original  scheme 

82.  Negative  Process:  Includes 

categories  82  to  85,  87,  95, 
96,  from  original  scheme 

7?.  Positive  Process:  Includes 

categories  72,  74  to  78, 
from  original  scheme 

86.  Fragmented  discussion:  Same 

as  original 

79.  Process  comments:  Same 
as  original 

97.  Laughter:  Same  as  original 

98.  Miscellaneous  comments: 
Same- as  original 

99.  Unintelligible  comments 
(Mi sslng  Data) : Same  as 

original 

i 
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A Chi  Square  (x2)  test  was  performed  using  the  revised  BCS  to  check 
whether  the  coders  and  the  check  coder  used  the  categories  with  about 
the  same  frequency.  Thus,  the  basic  question  was  whether  the  frequency 
distributions  for  the  two  sets  of  ratings  were  quite  similar.  The  xz 
coefficient  was  6.07  (p<. 90) , which  indicated  that  the  distributions 
were  very  similar.  In  order  to  express  this  in  terms  of  "coder-agreement" 
or  reliability,  a modified  Scott  coefficient,  developed  by  Flanders 
(1960)  was  computed.*  Scott's  formula  is: 


Percent  actual  agreement 

Percent  agreement  expected  by 
chance  (which  is  found  by 
squaring  the  percentage  frequency 
in  each  category  and  summing 
these  over  all  categories.) 


100  - Pe 

p 

where:  o = 


The  method  developed  by  Flanders  involves  the  following  calculations: 

1.  Tally  the  frequency  for  each  category  for  each  coder. 

2.  Compute  the  percentage  of  tallies  in  each  category  for  each 
coder, 

3.  Compute  the  percentage  difference  between  coders  for  each 
category.  The  sum  of  these  differences  is  the  percent 
disagreement  and  100  - % disagreement  = po. 

4.  Compute  the  average  percent  falling  in  each  category  and  square 
it.  The  sum  of  these  average  percent  figures  is  the  estimate  of 
pe. 

Thus,  the  modified  formula  becomes: 

7Tm  = (100  - % disagreement)  - (average  %)2 
100  - (average  %)2 

*Scott's  formula  (Scott,  1965)  is  usually  used  to  assess  uni t-by-unit 
agreement.  The  modified  version  developed  by  Flanders  may  be  used  to 
assess  agreement  in  terms  of  frequency  of  category  use. 
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Flanders  (1960)  stated  that  a tt^  of  0.85  or  higher  demonstrated  a 
reasonable  level  of  reliability,  based  on  his  investigation  of  the 
confidence  limits. 

In  the  present  case,  the  value  of  tt  was  .92.  Thus,  the  coding 
scheme  with  the  second  set  of  refinements  discussed  above  passed  the  first 
test  of  reliability.  Since  category  99  (unintelligible  comments,  i.e., 
missing  data)  contributed  no  content  information  to  the  scheme,  and  since 
the  X2  and  ir  values  indicated  that  category  99  was  used  with  approximately 
equal  frequency  by  any  two  raters,  this  category  was  eliminated  from 
further  a’ialyses. 

Three  questions  regarding  the  reliability  of  the  coding  scheme 
remained  to  be  answered: 

1 . How  much  agreement  was  there  between  the  check-coder  and  the 
coders  in  how  units  were  defined? 

2.  How  much  coder  agreement  was  there  in  speaker  identification? 

3.  To  what  extent  did  the  two  raters  agree  in  assigning  behavior 
categories  to  units? 

The  two  sets  of  ratings  (i.e.,  check-coder  vs.  coders)  were  compared 
in  various  ways  in  order  to  address  each  of  these  issues.  The  revised 
BCS  was  used  in  each  case. 

Unit  agreement.  A total  of  1,053  units  were  identified  by  either  the 
check-coder  or  coders  on  the  check-coded  portions  of  the  17  tapes.  Of 
these,  722  units  were  identified  by  both  raters,  constituting  68.6% 
agreement  on  unit  definition.  Among  the  331  units  over  which  there 
was  disagreement,  132  were  identified  by  the  coders  and  not  by  the  check- 
coder,  and  199  units  were  identified  by  the  check-coder  and  not  by  the 
coders.  Thus,  the  check-coder  tended  to  identify  more  units  than  did 
the  coders,  although  each  rater  identified  some  units  not  identified  by 
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the  other.  Overall,  It  appears  that  the  two  sets  of  raters  saw  the 
various  kinds  of  behaviors  defined  by  the  final  form  of  the  scheme 
with  the  same  frequency  (as  demonstrated  by  the  y2  and  nm 
coefficients)  but  broke  statements  down  into  units  somewhat  differently. 

A unit  agreement  of  68.6%  is  not  overwhelmingly  high;  but  neither  is  it 
disappointing,  or  unacceptably  low  given  the  complexity  of  the  rating 
task,  and  the  similarity  of  the  frequency  distributions  of  the  two  raters. 

Speaker  Identification.  The  next  step  was  to  assess  how  reliable 

the  two  sets  of  raters  were  in  identifying  the  voices  of  the  resource 

persons,  supervisors,  and  group  members.  Cohen's  unweighted  kappa  ('<) 

(1960)  was  used  to  assess  the  reliability  of  speaker  identification.* 

The  formula  is  „ _ f„  f and  has  the  same  rationale  and  chance- 
rs o-o 


agreement  correction  as  1^.  The  difference  between  K and  is  that  K 
is  used  for  assessing  the  reliability  of  nomirially-scales  categories  and 
thus,  involves  no  weighting  scheme.** 

As  stated  above,  there  were  five  speaker  notations,  one  for  the 
resource  person  (1),  the  supervisor  (2),  any  group  member  (3),  a general 
response  (4),  and  a notation  for  an  unidentifiable  speaker  (9).  There 
was  only  one  instance  in  which  any  rater  could  not  identify  the  speaker's 
voice  when  the  statement  itself  was  audible. 


"it 

Scott's  formula  (Scott,  1955)  was  not  used  because  it  assumes  that  the 
average  frequency  across  judges  for  all  categories  will  be  equal,  $n 
assumption  the  present  investigator  was  unwilling  to  make. 

**See  pp.  10-11  for  a more  complete  discussion  of  k as  an  estimate  of  coder 
reliability. 
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Taking  the  722  units  on  which  there  was  rater  agreement  on  the 
existence  of  a unit  per  se,  the  Kappa's  value  was  .95,  This  coefficient 
demonstrates  very  high  reliability  and  indicates  that  the  speaker  was 
correctly  identified  almost  wi thout  exception. 

Unit  Labelling.  Finally,  the  reliability  of  the  revised  Behavior 
Classification  Scheme  was  checked  in  terms  of  the  extent  to  which  the  two 
independent  raters  assigned  the  same  behavior  code  to  the  same  unit--i.e., 
the  degree  of  unit-by-unit  agreement  in  labelling.  Coder  agreement  in 
unit  labelling  was  assessed  separate  from  coder  agreement  in  speaker 
identification  because  identifying  the  speaker  and  the  behavior  were,  in 
fact,  two  independent  operations  even  though  both  were  recorded  for  each 
unit.  Once  again,  Cohen's  K (1960)  was  used  to  estimate  reliability. 

The  following  guidelines  were  established  regarding  category  99  which, 
as  stated  above,  was  eliminated  from  the  final  form  of  the  coding  scheme: 
For  a given  unit: 

If  the  check-coder  had  a 99,  the  coder  labelled  the  unit 
with  something  other  than  99,  ?nd  the  consensus  code  was 
the  same  as  the  coder's,  this  was  tallied  as  an  instanc- 
of  agreement.  If  the  coder  had  a 99,  the  check-coder  used 
another  category,  and  if  the  consensus  code  was  the  same  as 
the  check-coder's,  the  unit  was  not  counted.  If  both  the 
check-coder  and  the  coder  had  a 99,  the  unit  was  not  counted. 


The  total  number  of  units  used  in  computing  Kappa  was  722.  The  value  of 
Kappa  was  .726,  which  represents  a very  acceptable  level  of  chance-corrected 
coder  agreement. 
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Summary:  Overall  Reliability  of  BCS 

The  original  Behavior  Classification  Scheme  with  its  42  categories, 
proved  to  be  too  complex  for  use  in  coding  audio  tapes.  Thus,  on  the 
basis  of  early  analyses  regarding  the  similarity  of  the  frequency 
distributions  of  the  two  sets  of  raters,  the  scheme  was  condensed  by 
combining  sets  of  related  behavior  categories.  The  refined  scheme 
included  11  behavior  categories  and  five  speaker  notations.  Although 
the  refined  version  would  yield  less  information  than  its  original 
counterpart,  it  still  provided  a means  for  extracting  valuable  information 
from  the  survey- feedback  meetings. 

The  refined  Behavior  Classification  System  demonstrated  encouraging 
reliability  in  terms  of  the  frequency  distributions  of  the  behavior 
categories,  unit  definition,  unit  labelling,  and  speaker  identification. 
The  level  of  reliability  is  comparable  to  other  schemes  for  coding 
verbal  interactions  where  transcriptions  of  tapes  were  used  rather  than 
the  audio  tapes  themselves  (e.g.,  Massialas,  1970).  This  is  promising 

since  transcribing  tapes  is  a very  time-consuming  and  expensive  venture. 
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Behavior  Classification  Scheme:  Behavior  Indices 

Initially  the  BCS  data  for  each  meeting  were  streams  of  three-digit 
codes  with  the  first  digit  representing  the  speaker  and  the  last  two 
digits  representing  the  verbal  behavior  performed.  In  order  to  organize 
and  summarize  these  data,  two  data  management  operations  were  performed. 
First,  the  frequency  of  each  input  for  each  meeting  was  calculated. 

Three  "classes"  of  variables  were  relevant:  (1)  the  frequency  of  inputs 

by  each  speaker  independent  of  the  behavior  performed,  (2)  the  frequency 
of  each  behavior  Independent  of  the  speaker  performing  it,  and  (3)  the 
frequency  of  each  behavior  performed  by  each  speaker.  Calculating  all 
three  sets  of  frequencies  maintained  considerable  flexibility  in  the  types 
of  behavior  indices  that  could  be  created. 

Raw  frequencies  could  not  be  used  to  construct  indices,  however. 

The  meetings  varied  substantially  in  length  and  the  frequencies  varied 
accordingly.  Thus,  raw  frequencies  could  not  be  compared  in  a meaningful 
way  across  meetings.  The  second  data  management  step,  therefore,  was  to 
convert  the  raw  frequencies  to  proportions. 

As  stated  previously,  ti;e  basic  behavioral  dimensions  reflected  by 
the  BCS  were  the  content,  process,  and  mode  of  discussion.*  Each 
dimension  included  two  components:  content  inputs  included  problem- 

identification  and  problem-solving  behaviors;  process  inputs  included 
functional  and  dysfunctional  behaviors;  the  mode  of  discussion  included 


* 

The  miscellaneous  category  might  be  considered  a fourth  "dimension". 
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information-seeking  and  information-providing  inputs.  The  "behavior 
indices"  created  quantify  these  dimensions  and  their  components  by  con- 
verting the  frequencies  of  these  behaviors  to  ratios.  In  all,  27  behavior 
indices  were  created.  They  are  operationally  defined  below. 


CONTENT  INDICES: 

Problem-Identification  Index  (PI)  --  the  proportion  of  problem- 

identification  inputs  made.  The  PI  index  was  computed  for  each 
speaker  (i.e.,  resource  person,  supervisor,  group  members) 
by  summing  the  frequencies  for  categories  10  + 20  and  dividing 
by  the  total  number  of  inputs.  For  example,  the  formula  for 
the  resource  person  was:  1110  + 1120 

£l 

Problem-Solving  Index  (PS)  --  the  proportion  of  problem-solving 
inputs  made.  The  PS  index  was  computed  for  each  speaker  by 
summing  the  frequencies  for  categories  50  + 60  and  dividing 
by  the  total  number  of  inputs.  For  example,  the  formula  for 
the  resource  person  was:  £150  + £160 

— n 

Problem-Sol vinq/Content  Index  (PS/C)  --  the  proportion  of  all 
content  inputs  which  were  problem-solving  inputs.  This  index 
was  calculated  for  the  meeting  as  a whole.  The  formula  was: 

£50  + £60  . 

£10  + £20  + £5(3  + £60 

Content  Index  (C)  --  the  proportion  of  content  inputs  made.  This 
index  was  calculated  for  the  meeting  as  a whole.  The  formula 
was:  £10  + £20  + £50  + £60. 

£ T'+  £?  + £"3 


tu 


PROCESS  INDICES: 

Functional  Process  Index  (FP)  --  the  proportion  of  func  ional 
process  inputs  made,  excluding  reinforcement.  The  P index 
was  computed  for  each  speaker  and  for  the  meeting  as  a whole 
by  summing  the  frequencies  for  categories  72  + 79  and  dividing 
by  the  total  number  of  inputs.  For  example,  the  formula  for 
the  resource  person  was:  El 72  + E 1 79 . 

— n 

Dysfunctional  Process  Index  (DfP)  --  the  proportion  of  dysfunctional 
process  inputs  made.  The  DfP  index  was  computed  for  each 
speaker  and  for  the  meeting  as  a whole  by  summing  the  frequencies 
for  categories  82  + 86  and  dividing  by  the  total  number  of 
inputs.  For  example,  the  formula  for  the  resource  person  was: 

El  82  + El  86. 

El 


MODE  INDICES: 

Indirect  Structuring  Index  (I)  --  the  proportion  of  inputs  made 
which  influenced  the  discussion  indirectly  by  asking  questions 
and  reinforcing  other  people.  The  I index  was  calculated  for 
each  speaker  by  summing  the  frequencies  for  categories 
10  + 50  + 71  and  dividing  by  the  total  number  of  Inputs. 

For  example,  the  formula  for  the  resource  person  was: 

E110  + El  50  + El  71. 

n 

Direct  Structuring  Index  (D)  --  the  proportion  of  inputs  made 
which  directly  influenced  the  discussion  by  providing  content 
inputs.  The  D index  was  calculated  for  each  speaker  by  summing 
the  frequencies  for  categories  20  + 60  and  dividing  by  the 
total  number  of  inputs.  For  example,  the  formula  for  the 
resource  person  was:  El 20  + E160. 


GENERAL  INDICES : 


Activity  Level  (Act.)  --  the  proportion  of  inputs  made  by  each 
speaker.  This  index  was  calculated  for  each  speaker.  For 
example,  the  formula  for  the  resource  person  was:  El 

E1!  + E2  + E3 

Group  Conversation  (Grp.)  --  the  proportion  of  inputs  made  by  more 
than  one  person  simultaneously.  The  formula  was:  E4 

n + E2  + Z3  + 24 


Sidetracking  Index  (S)  --  the  proportion  of  miscellaneous  inputs 
made  during  a meeting.  The  formula  was:  E98 

El  + E2  + E3 
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Other  Instruments 

Prior  to  the  start  of  the  survey  feedback  meetings,  two  questionnaires 
were  administered.  The  organizational  functioning  of  the  work  groups 
was  assessed  using  a machine-scored,  standardized  instrument  entitled  the 
Survey  of  Organizations  (S00) . A description  of  the  complete  instrument 
together  with  statistical  information  regarding  the  validity  and  reliaDility 
of  its  component  items  is  provided  by  Taylor  & Bowers  (1972). 

The  questionnaire  includes  16  indices  and  measures  five  major  aspects 
of  organizational  1 ife--Cl imate  (pervasive  conditions).  Supervisory  Leader- 
ship (the  behaviors  of  a supervisor  toward  his/her  subordinates).  Peer 
Leadership  (the  behaviors  of  subordinates  toward  one  another).  Group  Process 
(how  group  members  work  as  a group),  and  Satisfaction.  Most  of  the 
questions  ask  the  respondent  to  rate  the  extent  to  which  behaviors, 
conditions,  and  practices  in  each  of  the  five  areas  were  characteristic 
of  their  work  setting  (see  Appendix  D) . 

The  S00  was  used  in  a variety  of  ways  in  this  study.  S00  data  were 
collected  at  the  outset  of  the  OD  effort  and  then  fed  back  to  work 
groups  for  discussion  in  the  feedback  meetings.  Approximately  18  months 
after  the  start  of  the  OD  project,  the  S00  was  re-administered.  These 
two  waves  of  S00  data  provided  a "pre"  and  "post"  measure  of  functioning 
for  a subset  of  groups  whose  composition  remained  relatively  constant  over 
the  18  months  (N  = 11  groups).  These  pre  and  post  measures  were  used  to 
classify  the  groups  as  "successful"  or  "unsuccessful."  Included  in  the 
latter  category  were  those  groups  that  did  not  change  and  those  that  changed 
for  the  worse.  The  procedure  for  classifying  each  group  included  five  steps 


1.  Scores  on  each  of  the  16  indices  for  each  group  was  judged  as 
increasing,  remaining  the  same,  or  decreasing  based  on  the 
direction  of  change  from  the  first  to  the  second  survey. 

2.  For  each  group,  a count  was  made  of  the  number  of  indices  for 
which  the  scores  increased,  remained  the  same,  or  decreased, 
and  the  predominant  direction  of  change  across  ii’dices  was 
noted. 

3.  Significance  of  the  number  of  indices  moving  in  the  predominant 
direction  was  then  evaluated  using  the  Sign  Test  (Siegel,  1956, 
pp.  68-75). 

4.  Where  the  confidence  of  change  in  either  direction  was  beyond 
the  five  percent  level,  the  group  was  judged  to  have  moved  in 
that  direction  ("increased"  or  "decreased").  Where  the 
significance  o*  the  predominant  direction  was  not  established 
by  this  criterion,  the  group  was  judged  as  not  changing. 

5.  The  five  groups  where  the  sign  tests  wore  significant  in  the 
direction  of  an  increase  were  placed  *'nto  the  "successful" 
category.  The  six  remaining  groups  were  classified  as 
"unsuccessful." 

Comparisons  were  made  Letween  these  two  categories  of  groups  across  the 
characteristics  measured  by  the  coding  schemes. 

Finally,  the  S00  measures  were  viewed  as  cne  set  of  ratings--by 
groups  cf  subordinates— of  various  work  setting  characteristics  that  could 
be  compared  to  ratings  of  similar  characteristics  by  other  raters  (e.g., 
the  coders,  the  supervisors).  An  instrument,  entitled  the  Supervisory 
Self-Rating  Form,  was  used  in  comparing  supervisors'  ratings  with  other 
ratings  of  leadership  behaviors.  This  instrument  included  questions 
paralleling  the  Supervisory  Leadership  items  iri  the  S00.  Supervisors 
were  asked  to  answer  each  of  the  questions  as  they  pertained  to  their  own 
supervisory  behaviors.  The  supervisors  filled  in  the;e  forms  prior  to 
receiving  the  S00  results  for  their  group  feedback  session. 


Preliminary  Findings 


Three  basic  issues  (in  addition  to  the  coder  reliability  on  the  BCS 
and  SRS)  were  explored  for  this  report:* 

1.  the  range  and  variability  of  behaviors  measured  by  the  BCS 
and  SRS , 

2.  the  strength  of  relationships  among  different  measures  of 
similar  behaviors,  and 

3.  the  existence  of  relationships  between  behaviors  during  the 
early  meetings  and  "outcomes." 

The  analyses  and  results  pertaining  to  each  issue  are  presented  below. 

The  smallness  of  the  present  sample— smallness  in  terms  of  both  number  of 
groups  and  number  of  meetings --limits  the  general izability  and  conclusiveness 
of  the  findings.  The  results,  therefore,  may  be  viewed  as  suggestive, 
but  preliminary. 


Range  and  Variability  of  Behaviors 

If  the  BCS  and  SRS  are  to  be  used  to  identify  feedback  meeting 
characteristics  which  affect  the  success  of  survey  feedback,  the  schemes 
must  be  sensitive  to  variations—as  well  as  simil ari ties— in  behaviors 
and  processes.  Table  6 presents  descriptive  statistics  on  the  BCS  and 
SRS  measures.  The  data  are  encouraging  on  at  least  three  points: 

• There  is  a substantial  range  in  the  mean  scores  for  the 
measures.  The  means  on  the  BCS  indices  range  from  .006  to 
.600.  The  means  on  the  SRS  Indices  and  single  items  range 
from  1.16  to  3.73  for  the  first  meeting  and  from  1.22  to 
4.44  for  the  second  meeting. 


Because  so  few  (N  = 4)  second  meetings  were  coded  using  the  BCS,  only 
the  SRS  measures  were  used  in  analyses  for  second  meetings.  Both  BCS 
and  S_RS_  measures  were  used  for  first  meetings. 


Table  6 


DESCRIPTIVE  STATISTICS  ON  BCS  AND  SRS  MEASURES 


N 

MEAN 

STD.  DEV. 

MINIMUM 

MAXIMUM 

BCS  MEASURES  (Mtg.  1) 


RP  (PI) 

16 

.54 

.17 

.09 

.91 

Sup  (PI) 

16 

.49 

.10 

.33 

.67 

Grp  (PI) 

16 

.12 

.07 

.02 

.27 

RP  (PS) 

16 

.11 

.09 

0 

.39 

Sup  (PS) 

16 

.06 

.06 

0 

.17 

Grp  (PS) 

16 

.06 

.06 

0 

.22 

Mtg.  (PS/C) 
Mtg.  (C) 

16 

16 

.11 

.60 

.09 

.06 

.004 

.50 

.36 

.68 

RP  (FP) 

16 

.14 

.07 

.07 

.35 

Sup.  (FP) 

16 

.14 

.05 

.07 

.21 

Grp.  (FP) 

16 

.04 

.03 

.01 

.14 

Mtg.  (FP) 

16 

.10 

.03 

.05 

.16 

RP  (DTP) 

16 

.01 

.01 

0 

.05 

Sup.  'DfP) 

16 

.02 

.02 

0 

.08 

Grp.  (DfP) 

16 

.02 

.02 

0 

,08 

Mtg.  (DfP) 

16 

.06 

.03 

.02 

.12 

RP  (I) 

16 

.36 

.10 

.16 

.52 

Sup.  (I) 

16 

.37 

.09 

.21 

.50 

Grp.  (I) 

16 

.29 

.09 

.19 

.46 

RP  (D) 

16 

.42 

.14 

.26 

.73 

Sup.  (D) 

16 

.39 

.12 

.23 

.59 

Grp.  (D) 

16 

.55 

.09 

.39 

.67 

RP  (Act.) 

16 

.19 

.12 

.04 

.36 

Sup.  (Act.) 

16 

.34 

.11 

.16 

.60 

Grp.  (Act.) 

16 

.46 

.09 

.33 

,67 

Mtg.  (Grp) 

16 

.08 

.04 

.03 

.14 

Mtg.  (S) 

16 

.09 

.04 

.03 

,16 

SRS  MEASURES  (Mtg.  1) 

SRS  1 : RP/Makes  Impact 

19 

3.18 

1.04 

1 .00 

5.00 

SRS  2:  RP/Over  Active/ 

Di recti ve 

19 

2.96 

1.24 

1.00 

5.00 

SRS  3:  RP/ Con fronts 

19 

1.42 

.77 

1.00 

4.00 

SRS44:  RP/Opposed 

19 

1.51 

.61 

1.00 

3.00 

SRS  5:  Sup.  Leadership 

19 

3.03 

.57 

1.67 

4.33 

SRS  6:  Sup.  Prevents 

Discussion 

19 

2.05 

.88 

1.00 

4.50 

SRS  7:  Grp.  Parti ci. 

19 

3.10 

.70 

2.00 

4.75 

SRS  8:  Grp.  Not 

Defensive 

19 

2.60 

.57 

1.50 

3.50 

SRS  9:  Productive  Mtg. 

19 

3.00 

.64 

2.00 

4.33 

Table  6 Continued 


N 

MEAN 

STD,  DEV. 

MINIMUM 

MAXIMUM 

SRS  10:  Meeting  Unsyst. 

19 

2.37 

.66 

1.50 

3.50 

SRS  11:  Objectives  Opp. 

19 

1.25 

.97 

0 

3.00 

SRS  12:  Problems  Outside 

Control 

19 

3.37 

.73 

1.75 

4.75 

SRS  13:  Grp.  Not 

Listening 

19 

2.24 

.65 

1.00 

3.50 

Q3:  Grp.  Requests  Inputs 

19 

1.57 

.69 

1.00 

3.00 

Q5:  RP/Info.  Resource 

19 

3.32 

1.45 

1.00 

5.00 

QS:  RP/Clear 

19 

3.74 

.81 

2.00 

5.00 

012:  KP/Intervenes  in 

Emot.  Encounters 

19 

1 .16 

.37 

1 .00 

2.00 

Q16:  Double  Messages 

19 

1 .53 

.70 

1.00 

3.00 

Q49:  Grp/Few  Dominate 

19 

2.47 

1.02 

1.00 

4.00 

Q22a:  Affect  Problems 

19 

3.05 

1.22 

1 .00 

5.00 

Q22b:  Info.  Problems 

19 

2.89 

1.20 

1.00 

5.00 

Q22c:  Skill  Problems 

19 

1.63 

.83 

1.00 

4.00 

Q25:  Cormvit.  to 

Solutions 

19 

1.74 

1.52 

0 

4.00 

Q29:  Frustration 

19 

2.16 

.69 

1.00 

4.00 

Q41 : Silence 

19 

1.47 

.70 

1.00 

3.00 

SRS  MEASURES  (Mtg.  2) 

SRS  1 

18 

3.14 

.80 

2.00 

4.50  J 

SRS  2 

18 

3.08 

1.00 

1.25 

4.50 

SRS  3 

18 

1.53 

.50 

1.00 

2.50 

SRS  4 

13 

1 .42 

.34 

1.00 

2.33 

SRS  5 

18 

3.01 

.84 

1.33 

4.33 

SRS  6 

18 

2.22 

.97 

1.00 

4.50 

SRS  7 

18 

3.08 

.92 

1 .75 

4.75 

SRS  8 

18 

2.83 

1.00 

1.50 

5.00 

SRS  9 

18 

2.86 

.88 

1.33 

4.17 

SRS  10 

18 

2.89 

.95 

1.00 

4.50 

SRS  11 

18 

1.22 

1.18 

0 

3.00 

SRS  12 

18 

3.29 

.73 

2.50 

5.00 

SRS  13 

18 

2.44 

1.06 

1.00 

4.50 

Q3 

18 

1.44 

.62 

1.00 

3.00 

Q5 

18 

3.17 

1.10 

2.00 

5.00 

Q8 

18 

4.00 

.77 

3.00 

5.00 

012 

18 

1.72 

«■  .83 

1.00 

3.00 

Q16 

18 

1.83 

.71 

1.00 

3.00 

Q49 

18 

2.11 

1 .08 

1.00 

4.00 

Q22a 

18 

3.44 

1.20 

1.00 

5.00 

Q22b 

18 

2.44 

.98 

1 .00 

4.00 

Q22c 

18 

1.50 

.86 

1.00 

4.00 

Q25 

18 

1.56 

1.46 

0 

4.00 

Q29 

18 

2.33 

1.03 

1 .00 

4.00 

Q41 

18 

1 .72 

1.02 

1.00 

4.00 
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• There  is  a substantial  range  in  the  standard  deviations 
(s.d.)  for  the  measures.  The  s.d.'s  on  the  BCS  indices 
range  from  .01  to  .14.  The  s.d.'s  on  the  SRS  measures 
range  from  .37  to  2.57  for  the  first  meeting,  and  from 
.34  to  2.15  for  the  second  meeting. 

• In  many  cases  the  minimum  and  maximum  scores  cover  a 
wide  range  of  the  possible  responses.  On  13  out  of 
the  25  SRS_  measures  (i.e.,  52%)  the  differences  between 
the  minimum  and  maximum  scores  is  at  least  3.00.  (In 
most  cases,  the  maximum  difference  possible  is  4.00). 

This  holds  for  both  first  and  second  meetings. 

Thus,  the  data  indicate  that  the  BCS  and  SJRS^  measured  a range  of  character- 
istics, some  of  which  were  relatively  similar  across  groups  and  many  which 
varied  across  groups. 

A similar  question  concerns  whether  the  SRS  and  BCS  measures  were 
sensitive  to  similarities  and  differences  across  people.  To  explore  this 
issue,  one-way  analyses  of  variance  were  performed  on  measures  of  resource 
person  (RP)  behavior  for  the  five  internal  resource  people.  The  results 
are  shown  in  Table  7. 

As  indicated  in  the  table,  the  five  RP's  differed  significantly 
(p<.05)  on  four  out  of  15,  or  about  one-fourth,  of  the  measures.  There 
were  significant  differences  in  RP  activity  levels  (two  measures)  and  the 
extent  to  which  the  RP's  were  clear  and  acted  as  Information  resources. 
During  the  second  meetings,  there  were,  once  again,  significant  differences 
(p<.05)  on  two  out  of  eight,  or  one-fourth,  of  the  measures.  During  these 
meetings,  the  RP's  differed  in  the  extent  to  which  they  were  overactive 
and  the  extent  to  which  they  confronted  group  members.  Thus,  more 
similarities  than  differences  In  RP  behavior  were  tapped  by  the  coding 
schemes.  Some  variations  were  identified,  however. 


Table  7 


ANALYSES  OF  VARIANCE  OF  RP  BEHAVIORS  BY  RP 


Level  Of 


df 

F-Ratio 

Significance 

BCS  MEASURES  (Mtq.  1) 

RP  (PI) 

4,  11 

1 .60 

p<.24 

RP  (PS) 

4,  11 

2.30 

p< . 12 

RP  (FP) 

4,  11 

.68 

p<.62 

RP  ( DfP) 

4,  11 

.91 

pc.  49 

RP  (I) 

4,  11 

.73 

p<. 60 

RP  (D) 

4,  11 

1 .77 

pc. 20 

RP  (Act.) 

4,  11 

12.16 

pc. 001 

SRS  MEASURES  (Mtg.  1) 

SRS  1:  RP/Makes  Impact 

4,  14 

1.39 

pc. 29 

SRS  2:  RP'Over  Active/  Directive 

4,  14 

13.41 

pc. 001 

SRS  3:  RP/ Con  fronts 

4,  14 

.33 

pc.  85 

SRS  4:  RP/Opposed 

4,  14 

.49 

pc.  75 

03:  Grp.  Requests  Inputs 

4,  14 

.66 

pc. 63 

05:  RP/Info.  Resource 

4,  14 

12.78 

pc. 001 

08:  RP/Clear 

4,  14 

8.43 

pc. 001 

012:  RP/ Intervenes  in  Emotional 

Encounters 

4,  14 

.41 

pc.  80 

SRS  MEASURES  (Mtq.  2) 

SRS  1 

3,  14 

.62 

pc. 61 

SRS  2 

3,  14 

3.51 

pc. 04 

S RS  3 

3,  14 

4.92 

pc. 01 

SRS  4 

3,  14 

1 .22 

pc.  34 

03 

3,  14 

.06 

pc. 98 

05 

3,  14 

1.27 

pc.  32 

08 

3,  14 

2.08 

pc. 15 

012 

3,  14 

1.41 

pc. 28 
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Relationships  Among  Multiple  Ratings  of  Behaviors 

The  data  in  this  study  were  limited  in  terms  of  the  number  of  cases, 
yet  rich  in  terms  of  the  number  and  type  of  variables  measured  and  the 
measurement  procedures  used.  Two  somewhat  different  ratings  of  behaviors 
in  the  same  situation  were  provided  by  the  BCS  and  the  SRS.  In  addition 
to  coders'  ratings  of  behavior  during  meetings,  however,  the  SOO  provided 
subordinates'  ratings  and  the  Supervisory  Self-Rating  Form  provided 
supervisors'  ratings  of  general  functioning  in  the  work  situation.  In 
the  following  pages  selected  comparisons  among  these  ratings  are  made. 

Interrelationships  of  the  Coding  Schemes.  The  first  set  of  comparisons 
were  made  in  order  to  explore  the  interrelationships  of  the  SRS  and  BCS. 

The  coding  schemes  provide  two  slightly  different  ratings  of  behavior  in 
the  same  situation.  The  number  of  "comparable"  behaviors  measured  were 
somewhat  limited.  Nevertheless,  a few  com/arable  measures  were  available 
for  each  of  four  aspects  of  the  meetings--! .e. , the  character  of  the 
meeting  as  a whole,  and  behaviors  of  the  resource  person,  the  supervisor, 
and  the  group  members. 

Table  8 lists  the  sets  of  measures  compared  and  shows  the  correlations 
between  each  set.  Overall,  the  correlations  were  moderately  high— ranging 
from  ! . 1 0 J to  | . 81 1 1 for  characteristics  of  the  meetings  as  a whole,  the 
resource  person,  and  the  group  members.  The  median  correlation  was  .434. 

The  measures  of  supervisory  behaviors,  however,  were  only  weakly  related, 
with  a median  correlation  of  -.082.  The  correlations  of  supervisory  behaviors 
ranged  from  | . 01 8 | to  |,281|. 


Table  8 


CORRELATIONS  BETWEEN  SELECTED  BCS  AND  SRS  MEASURES 


Measures 

Correlation  (N  = 16) 

MEETING  CHARACTERISTICS 

SRS  9:  Productive  Mtg.  & Mtg  (PS/C) 

.492* 

& Mtg.  (C) 

.439 

SRS  10:  Discussion  Unsystematic  & Mtg.  (S) 

.263 

RESOURCE  PERSON  CHARACTERISTIC* 

SRS  2:  RP/Over  Active/Directive  & RP  (Act.) 

.811** 

Q5:  RP/Info.  Resource  & RP  (I) 

.522* 

& RP  (D) 

-.458 

SRS  1 : RP/Makes  Irroact  & RP  (I) 

.379 

& RP  (D) 

-.473 

Q53:  RP/Directs  Discussion  & RP  (I) 

.223 

& RP  (D) 

-.435 

SUPERVISOR  CHARACTERISTICS 

Q48:  Sup.  Dominates  & Sup  (Act.) 

-.082 

Q43:  Sup.  Open  & Sup.  (FP) 

.075 

& Sup.  )DfP) 

.281 

Q44:  Sup.  Team  Builds  & Sup.  (FP) 

-.106 

& Sup.  (DfP) 

.188 

Q51:  Sup.  Directs  & Tup  (I) 

.018 

& Sup.  (D) 

.032 

GROUP  MEMBER  CHARACTERISTICS 

04?-  Rattle  for  Airtime  & Mtg.  (Grp.) 

.559* 

Q38:  Grp.  Participation  & Grp.  (Act.) 

.434 

Q37:  High  Quality  Interaction  & Grp.  (FP) 

-.100 

& Grp.  (DfP) 

-.'111 

Q52:  Grp.  Directs  ft  Grp  (I) 

-.147 

ft  Grp  (D) 

.210 

* = p<,05 
**  = pc. 01 
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In  addition  to  the  reasonable  strength  of  many  of  the  relationships, 
the  correlations  were  usually  in  the  appropriate  direction.  For  example, 
the  SRS  measure  "Productive  Meeting"  is  positively  related  to  the  BCS 
measures  of  problem-solving  and  content  inputs  made  during  the  meeting 
(v  = .492  and  .439  respectively).  The  measures  of  "activity"  have 
especially  high  intercorrelations.  The  BCS  measure  of  the  RP's  activity 
level  is  correlated  .811  (p<.05)  with  the  SR^  measure  "RP  Overly  Active/ 
Directive."  The  BCS  measure  of  group  conversation  is  correlated  .559 
(p<. 05)  with  the  SRS  measure  "Battling  for  Air  Time."  And  the  BCS  measure 
of  group  member  activity  level  is  correlated  .434  with  the  SRS  measure 
"Group  Participation." 

There  were  also  some  interesting  correlations  between  the  BCS  and 
SRS  measures  of  the  resource  persons'  behaviors.  Direct  Structuring  was 
defined  in  the  BCS^  as  providing  problem-identification  or  problem-solving 
inputs  while  indirect  structuring  was  defined  as  seeking  these  inputs  and 
reinforcing  other  people's  inputs.  The  correlations  between  the  two  coding 
schemes  indicate,  however,  that  the  BCS  measure  of  direct  structuring  by 
the  RP  is  negati vely  related  to  the  SRS_  measures  RP/information  resource 
(r  = -.458),  RP/directs  discussion  (r  = -.435),  and  RP/makes  impact 
(r  = -.473).  The  BCS  measure  of  indirect  structuring,  on  the  other  hand, 
is  positively  related  to  these  three  SRS  measures.  Thus,  the  RP  appears 
to  have  made  more  impact  and  to  have  "directed"  the  discussion  more  by 
asking  questions  than  by  answering  them.  This  indicates  that  "Providing 
Content  Inputs"  might  be  a more  descriptive  index  name  than  the  present 
"Direct  Structuring"  label  for  the  BCS  measure. 


There  is  a range,  then,  in  the  strength  and  direction  of  the  relationships 


between  SRS  and  8CS  measures.  A more  precise  test  of  how  these  two  types  of 
coding  schemes  are  interrelated  would  be  possible,  however,  by  adding  some 
measures  to  the  SRS  which  more  closely  parallel  the  BCS  measures.  The 
stronger  correlations  were  found  between  the  most  parallel  or  comparable 
questions  (e.g.,  activity  levels). 

Multi -Method  Ratings  of  Supervisory  Leadership.  As  stated  previously, 
three  ratings  of  supervisory  leadership  were  gathered--the  SRS  ratings  by 
the  coders,  the  $00  ratings  by  the  subordinates,  and  the  self-ratings 
by  the  supervisors.  Four  major  dimensions  of  supervisory  leadership  were 
tapped  by  all  three  sets  of  ratings: 

Support--the  extent  to  which  the  supervisor  lets  subordinates 
know  that  they  are  worthwhile  persons  doing  useful  work. 

Team  Bui lding--the  extent  to  which  the  supervisor's  behavior 
encourages  subordinates  to  develop  close,  cooperative 
working  relationships  with  one  another. 

Goal  Emphasis--the  extent  to  which  the  supervisor's  behavior 
stimulates  a contagious  enthusiasm  among  his  suboroinates 
for  doing  a good  job  (not  pressure). 

Work  Faci li tation--the  extent  to  which  a supervisor's  behavior 
removes  roadblocks  to  doing  a good  job  (Bowers  & Seashore, 

1966). 

The  questions  used  to  measure  each  dimension  are  listed  in  Table  9.  S00 

and  self-rating  measures  were  indices  comprised  of  two  or  more  items. 

The  SRS  measures  were  single  items. 

Table  10  shows  the  correlations  among  these  three  sets  of  ratings. 
While  the  N's  were  very  small  and  the  correlations  were  not  statistically 
significant  for  the  most  part,  some  interesting  patterns  emerge.  First, 
the  coders'  ratings  (for  both  meetings)  and  the  S00  measures  were  negatively 
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related  to  supervisors'  self-ratings.  The  coders'  ratings  and  the  SOO 
measures  were,  on  the  other  hand,  positively  but  very  weakly  related. 

It  would  be  interesting  and  fruitful  to  explore  these  relationships  with  a 
larger  sample  to  test  whether  (1)  "third-party"  ratings  are,  in  fact,  only 
weakly  related  to  perceptions  of  subordinates;  whether  (2)  ratings  of 
average  supervisory  behavior  are  only  weakly  related  to  supervisory  behavior 
in  specific  settings--e.g. , feedback  meetings;  and  whether  (3)  supervisors' 
ratings  of  themselves  are  often  the  reverse  of  others'  ratings  of  them. 

Differences  Between  Successful  and  Unsuccessful  Groups 

The  question  of  which  feedback  meeting  characteristics  affect  the 

ultimate  success  of  survey  feedback,  while  of  considerable  interest, 

cannot  really  be  investigated  with  the  present  data  set.  A modified 

question  may  be  posed,  however: 

Do  the  meetings  of  groups  that  engage  in  survey  feedback 
successfully  differ  from  the  unsuccessful  groups  as  early 
as  the  first  two  feedback  meetings? 

This  question  focuses  on  identifying  characteristics  of  meetings  which  are 
either  very  fixed  or  very  determining,  since  their  presence  at  the  outset 
would  distinguish  between  the  "successful"  and  "unsuccessful"  groups 
defined  several  months  later.  To  answer  this  question,  Student's  T-Tests 
were  performed.  The  mean  scores  on  the  BCS  and  SRS  measures  for  the 
"successful " versus  the  "unsuccessful " groups  were  compared,* 


The  procedure  for  classifying  groups  as  successful  or  unsuccessful  was 
described  on  page  40. 
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The  results  of  the  t-tests  are  presented  as  Appendix  C.  It  seems 
sufficient  to  say  here  that  the  number  of  characteristics  on  which  the 
successful  and  unsuccessful  groups  differed  significantly  could  easily 
have  occurred  by  chance.  There  were  no  statistically  significant 
differences  (p<. 05)  between  the  two  sets  of  groups  during  the  first 
meeting,  and  only  one  (out  of  25)  comparison  was  significant  for  the 
second  meeting.*  This  finding  indicates  that  groups  are  not  doomed  to 
failure  or  assured  of  success  based  on  the  way  their  first  two  feedback 
meetings  progress. 


The  successful  groups  had  less  participation  by  group  members  duri.ig  the 
second  meeting  than  the  unsuccessful  groups.  This  may  Indicate  that  the 
successful  groups  had  more  room  for  improvement  at  the  beginning  of 
the  OD  effort. 


Summary  and  Suggestions  for  Further  Research 


Two  coding  schemes  were  developed  and  subjected  to  preliminary  analyses 
for  this  study.  The  Behavior  Classification  Scheme  (BCS_)  included  eleven 
behavior  and  four  speaker  categories  which  were  used  to  code  each  problem- 
solving input  made  during  a survey  feedback  meeting.  The  Sumnary  Rating 
Scheme  (SRS)  included  several  survey  questions  regarding  the  feedback 
meeting  which  coders  answered  after  listening  to  an  entire  meeting. 

The  analyses  performed  suggest  that  the  two  schemes  are  feasible  tools 
for  documenting  what  transpires  during  survey  feedback  sessions: 

• their  coding  reliability  and  validity  is  acceptable; 

• the  schemes  seem  sensitive  to  both  similarities  and 
differences  in  meetings  and  consultant  styles;  and 

• there  are  some  moderate  correlations  between  comparable 
SRS  and  BCS  measures. 

In  addition  to  their  potential  use  as  documentation  tools,  however, 
the  schemes  may  be  used  to  gather  "third  party"  perceptions  of  a variety 
of  organizational  variables.  In  this  case,  coder  ratings  of  supervisory 
leadership  were  used  in  conjunction  with  subordinate  ratings  and  supervisors' 
self-ratings  to  assess  the  relationships  among  multiple  ratings  of  super- 
visory leadership.  The  results  were  somewhat  surprising.  Supervisors' 
self-ratings  tended  to  be  the  reverse  of  ratings  provided  by  both  their 
subordinates  and  the  coders.  Coders'  ratings  were  positively  but  only 
weakly  related  to  subordinate  ratings.  While  the  sample  was  quite  small. 
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the  pattern  of  correlations  indicate  that  the  three  ratings  provide  quite 
different  information. 

Future  efforts  to  study  feedback  meetings  using  the  BCS  and  SRS 
should  involve  at  least  two  extensions  of  the  present  research.  One 
extention  focuses  on  reducing  the  coding  time  required  for  each  meeting. 

In  the  present  study,  the  audio  tapes  of  entire  meetings  were  coded.  It 
might  be  possible  in  the  future,  however,  to  code  a few  ten-minute  segments 
of  each  meeting  without  sacrificing  the  essence  of  the  meeting.  This 
possibility  could  be  explored  by  experimenting  with  different  time-sampling 
methods . 

Secondly,  the  sample  of  meetings  included  for  each  group  should  cover 
feedback  sessions  from  the  early,  intermediate,  and  advanced  stages  of  the 
survey  feedback  effort.  In  the  present  study  only  the  earliest  meetings 
were  included,  Understandably,  successful  and  unsuccessful  groips  (as 
defined  by  change  in  the  S00  scores)  did  net  differ,  for  the  most  part, 
in  terms  of  the  behaviors  occurring  in  the  first  and  second  feedback 
meetings.  Extending  the  sample  to  include  later  meetings  would  allow  one 
to  observe  the  paths  of  and  differences  between  successful  and  unsuccessful 
groups  over  time. 


APPENDIX  A:  THE  CODING 
SCHEMES 
AND  CODING 
GUIDELINES 
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13-14  MEF,TTNC  NUMBER  (from  ID  form) 

15-17  DECK  NUMBER  (001) 

18-19  RESOURCE  PERSON  NUMBER  (from  ID  form) 

01.  G 

02.  M 

03.  R 

04.  P 

05.  D 

20-21  PA IZL  MEETING— MONTH  (from  ID  form) 

Code  actual  month  (01-12) 

99.  NA 

22-21  DATE  OF  MEETING— DAY  (from  ID  form) 

Code  actual  day  of  the  month  (01-31) 
99.  NA 
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Deck  001 


Column 

24-25  DATE  OF  MEETING — YEAR  (from  ID  form) 

73.  1973 

99.  NA 


26-28  LENGTH  OF  MEETING  (MIN.) 


Code  approximate  length  of  meeting  in  minutes  (001-997) 


29-30  GROUP  SIZE  (from  ID  form) 

Code  actual  number  of  group  members  (not  including  supervisor)  who 
filled  out  the  S00  questionnaire. 


31-32  GROUP  FUNCTION  (from  ID  form) 

Code  predominant  function  performed  by  group  members. 

White  Collar 

01.  Production  I — production  tasks  requiring  low  skill  levels 

02.  Production  II — production  tasks  requiring  moderate  skill  levels 

03.  Production  III — production  tasks  requiring  high  skill  levels 

04.  Quality  control — non-supervisory  checking  or  product  quality 

05.  Clerical — includes  typing,  filing,  editing,  etc. 

06.  Line  supervision  (production  areas  only) 

07.  Staff  supervision  (supervisors  in  personnel,  administrative,  or 
technical  areas, 

08.  Sales/Marketing  Supervisor 

09.  White.  Collar,  NA  Specific  function 


Blue  Collar 

11.  Production  I — production  tasks  requiring  low  skill  levels 

12.  Production  II — production  tasks  requiring  moderate  skill  levels 

13.  Production  III — production  tasks  requiring  high  skill  levels 

14.  Ouality  Control — non-supervisory  checking  or  product  quality 
19.  Blue  Collar,  NA  specific  function 


99. 


NA 
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Deck  001 


Column 


CODER/CHECK-CODER 

NUMBER 

Coder  1, 

BD 

2. 

RG 

3. 

CS 

4. 

PP 

5. 

Check  coder  6. 

BD 

7. 

RG 

8. 

RS 

9. 

PP 

0. 
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Deck  001 


CODER  ANALYSIS  OF  GROUP  MEETING 

Use  the  5~point  extent  scale  below  to  answer  the  following  questions 
(1-22,  25-41)  and  on  Deck  044  (42-53). 

Five-Point  Extent  Scale 

1.  To  a very  little  extent 

2.  To  a little  extent 

3.  To  some  extent 

4.  To  a great  extent 

5.  To  a very  great  extent 


Column 


I THE  RESOURCE  PERSON 


34 

01. 

PROCESS  REMARKS:  To  what  extent  did  the  resource  person  make  comments 
which  affected  the  process  of  the  discussion  (e.g.  , making  maintenance 
inputs)? 

35 

02. 

STATEMENTS  ABOUT  GROUP  MEMBERS  RELATING:  To  what  extent  did  the 

resource  person  make  statements  about  how  group  members  were  relating 
to  each  other? 

36 

03. 

GROUP  WANTS  INPUTS:  To  what  extent  did  the  group  request  inputs  from 

the  resource  person? 

37 

04. 

MORE  INPUTS  THAN  WANTED:  To  what  extent  did  the  resource  person  make 

more  Inputs  than  the  group  seemed  to  want? 

38 

05. 

RP  AS  INFORMATION  RESOURCE:  To  v’hat  extent  did  the  resource  person  acl 

as  an  information  resource? 

39 

06. 

i 

DIAONOSIS/STIMULATION:  To  what  extent  was  the  resource  person  active 

in  making  diagnostic  comments  and/or  stimulating  action  steps? 
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Deck  00 


Column 


40  07.  CONFRONTATION  BY  RP : To  what  extent  did  the  resource  person 

actively  confront  group  members? 


41  08.  CLARITY : To  what  extent  were  the  resource  person’s  statements  easy 

to  understand?  (Clarity  of  meaning;  not  quality  of  tape  reproduction  I ) 


42  09.  RP  PRIMARILY  ANSWERING  QUESTIONS:  To  what  extent  did  the  resource 

person  remain  silent  except  when  responding  to  questions  directed 
toward  her/him? 


43  Q10.  CONFLICT  WIT}'  GROUP:  To  what  extent  did  conflict  exist  between  the 

resource  person  and  others  at  the  meeting? 


44  Qll.  RESISTANCE  TOWARD  RP : When  the  resource  person  intervened,  to  what 

extent  was  resistance  encountered  in  response  to  the  intervention? 


45  Q12 . RP  INTERVENES  IN  EMOTIONAL  ENCOUNTERS:  To  what  extent  did  the  resourc 

person  intervene  in  emotional  encounters  between  others  at  the  meeting 


46  013.  RP  ATTACKED:  To  what  e:<tent  was  the  resource  person  attacked  by  the 

group  for  suggesting  changes? 


IT  THE  GROUP  ITSELF 

47  014,  MISUNDERSTANDING  EACH  OTHER:  To  what  extent  did  group  members 

(including  the  supervisor)  misunderstand  each  other? 


Q15.  SUPERVISOR  COMPETENT:  To  what  extent  was  the  supervisor  competent  in 

leading  the  discussion? 


48 
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Deck  001 


Column 


49  016.  DOUBLE  MESSAGES:  To  what  extent  were  double  messages  being  sent? 

That  is,  to  what  extent  were  there  discrepancies  between  a parti- 
clpant's  verbal  message  and  his  emotional  message? 


50  017.  HONESTY  ABOUT  SELF:  To  what  extent  were  members  (including  the 

supervisor)  honest  and  candid  about  themselves? 


51  018.  I-HAVE-TO-CHANGE  ATTITUDE:  To  what  extent  did  individuals  take  an 

_ "T 'm-the-one-who-has-to-change"  attitude? 


52  Q19.  OTHERS-MUST-CHANGE  ATTITUDE:  To  what  extent  was  a " chan ge-the-o the r- 

guy"  attitude  in  evidence? 


53  Q20.  SYSTEMATIC  APPROACH:  To  what  extent  was  the  problem-solving 

sequence  (the  content  inputs)  followed  systematically? 


54  Q21,  SIDE-TRACKING:  To  what  extent  did  the  discussion  get  side-tracked  on 

to  inconsequential  topics? 


55 

56 

57 

58 


Q22.  TYPES  OF  PROBLEMS  DISCUSSED:  To  what  extent  were  each  of  the  following 

types  of  problems  th  focus  of  the  discussion: 

22a.  Problems  related  to  feelings  or  affect  or  values. 

22b.  Problems  related  to  the  lack,  or  inaccuracy,  of  information. 

22c.  Problems  related  to  the  lack  of  needed  skills. 

22d.  Problems  related  to  constraints  created  by  the  situation. 


59  Q23.  TYPE  DISCUSSED  MOST:  Which  type  of  problem  did  the  group  discuss 

most? 


1.  Affect-related 

2.  Information-related 

3.  Skill-related 

4.  Situation-related 

5.  Combination  of  abo^e 


ADDITIONS  TO  DECK  001 


Col . 


69 

Q 30.  MAINTENANCE  INPUTS:  To  what  extent  were  maintenance  inputs  j 

provided  by  the  resource  person,  supervisor,  and  group  ' 

nembers? 

70 

Q 31.  CONTENT  INPUTS:  To  what  extent  were  content  inputs  provided? 

71 

' ' , , ( ” i . . - ' 

| J r 

Q 32,  PROBLEMS  IDENTIFIED:  To  what  extent  were  real  problems 

identified? 

72 

Q 33.  ATTEMPTS  TO  SOLVE  PROBLEMS:  To  what  extent  were  there  attempts 

to  solve  problems  which  were  identified? 

73 

( 

Q 34.  PROBLEMS  SOLVED:  To  what  extent  were  problems  actually  solved? 

74 

Q 35.  PROBLEMS  WITHIN  CONTROL:  To  what  extent  were  the  problems 

discussed  within  the  control  of  the  work  group  and  supervisor? 

75 

Q 36.  PROBLEMS  OUTSIDE  CONTROL:  To  what  extent  were  the  problems  dis- 

cussed outside  the  control  of  the  work  group  and  supervisor? 

76 

Q 37.  QUALITY  OF  INTERACTION:  To  what  extent  was  the  group  interaction 
of  "high  quality"? 

77 

Q 38,  PARTICIPATION:  To  what  extent  did  group  members  participate  in 

the  discussion? 

75 

Q 39,  GROUP  INTERACTION:  To  what  extent  did  group  members  interact 

mth  each  other  (rather  than  merely  responding  to  the  supervisor)? 

79 

Q 40.  WILLINGNESS  TO  TmlK  ABOUT  PROBLEMS:  To  what  extent  were  group 

members  willing  to  talk  about  probl  >s? 

80 

Q 41.  SILENCE:  To  what  extent  were  there  long  periods  of  silence 

during  the  meeting? 
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Deck  001 


Co  lumn  . ■ •' 

If  the  group  attempted  to  solve  problems  during  this  meeting,  answer 
question  24  and  25;  otherwise  code  0 in  cols,  57-8  and  go  to  question  26. 

60  Q24.  TYPE  ATTEMPTED  FIRST:  Which  type  of  problem  did  the  group  attempt 

to  solve  first? 


1.  Aspect-related 

2.  Information-related 

3.  Skill-related 

4.  Situation-related  , ; 

0.  Inap , group  attempted  no  solution 


61  025.  CONSENSUS  ON  SOLUTIONS:  To  what  extent  was  there  con  sens', 

commitment  to  the  solutions  advanced? 


Use  5-point  extent  scale,  EXCEPT : 

0.  Inap,  group  attempted  no  solutions 

I ; . 

I 

62  Q26.  EXPLANATION  OF  OBJECTIVES:  To  what  extent  were  change  objectives 

of  the  program  clearly  explained  to  group  members? 


63  Q27.  DISAGREEMENT  ON  OBJECTIVES:  To  what  extent  was  there  disagreement  on 

change  objectives? 


64  028.  RESISTANCE  TO  OBJECTIVES:  To  what  extent  t*  there  resistance  to  the 

change  objectives? 


65 


029.  FRUSTRATION:  How  mi-  frustration  was  in  evidence? 


1.  A little  frustration 

2.  Some  frustration 

3.  Considerable  frustration 
deal  of  frustration 


4.  A 
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Deck.  001 


Column 

66  SEX  OF  SUPERVISOR  (from  ID  form) 

1.  Female 

2.  Male 


67  WAS  THE  ENTIRE  MEETING  TAPED? 

1.  Yes 
2 . No 


GROUP  SIZE  - NO,  IN  ATTENDANCE  (from  ID  form) 


68 


v;? 


DECK  044 


Col . 

1-33  ID  Information  (same  as  for  Deck  001). 


34  Q 42.  BATTLING  FOR  AIR  TIME:  To  what  extent  were  people  "battling" 
for  air-time?  i.e,,  to  what  extent  were  people  interrupting 
each  other  and  talking  all  at  once  in  order  to  get  their  opinions 
voi ced? 


35  Q 43.  SUPERVISOR  OPEN:  To  what  extent  did  the  supervisor  seem  open 

to  the  opinions  and  ideas  of  his/her  subordinates? 


36  Q 44,  SUPERVISOR  A TEAM  BUILDER:  To  what  extent  did  the  supervisor 

encourage  group  members  to  work  together  as  a team? 


37  Q 45.  SUPERVISOR  A FACILITATOR:  To  what  extent  did  the  supervisor  help 
to  remove  roadblocks  to  solving  problems? 


38  Q 46.  SUPERVISOR  EMPHASIZES  GOALS:  To  what  extent  did  the  supervisor 

emph asize  goals  (work,  change  objectives,  etc.)?  (not  pressure) 


39  Q 47,  SUPERVISOR  SUPPRESSES:  To  what  extent  did  the  supervisor  suppress 

group  discussion  through  his/her  attitude  or  actions? 

40  Q 48.  SUPERVISOR  DOMINATES:  To  what  extent  did  the  supervisor 

dominate  the  discussion? 


41  Q 49.  GROUP  MEMBERS  DOMINATE:  To  what  extent  did  a few  group  members 

dominate  the  discussion? 


42  Q 50.  RESOURCE  PERSON  DOMINATES:  To  what  extent  did  the  resource 

person  dominate  the  discussion? 


43  q 51 . SUPERVISOR  DIRECTS:  To  what  extent  did  the  supervisor  actively 

direct  the  discussion? 


44  q 52.  GROUP  MEMBERS  DIRECT:  To  what  extent  did  the  group  members 

actively  direct  the  discussion? 

45  Q 53.  RESOURCE  PERSON  DIRECTS:  To  what  extent  did  the  resource 

person  actively  direct  the  discussion?  ______ 
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FEEDBACK  SESSION  TAPES 


Decks  002-XXX 


Column 

1-4  STUDY  NUMBER  (1712) 

5-9  GROUP  NUMBER 

10-11  MEETING  NUMBER 

12-14  DECK  NUMBER- -number  decks  sequentially  from  002  to  as  many  as  necessary 

to  complete  the  coding  of  one  meeting. 


Starting  in  columns  18-19,  code  in  order  the  problem-solving  units  occurring  in 
the  meeting.  These  are  coded  in  three-digit  groups,  the  first  digit  indicating  the 
speaker,  the  second  two  indicating  which  type  of  input  the  speaker  made.  In  general 
every  change  of  speaker  should  generate  a new  three-digit  group,  although  one  speake 
may  generate  several  consecutive  groups.  Guidelines  and  detailed  definitions  of  the 
input  categories  are  given  on  the  following  pages. 

Mien  Deck  002  is  filled  (through  col.  80),  continue  in  Deck  003  on  the  same 
code  sheet,  skipping  a line  between  decks  to  allow  room  for  inserts.  If  more  than 
10  decks  are  needed,  continue  on  a second  code  sheet  (and  on  more  as  needed).  If 
there  is  any  space  left  on  the  last  deck  when  the  meeting  is  finished,  code  0 in  the 
remaining  columns  of  that  deck,  through  col.  80. 

Tape  Log.  For  each  tape,  keep  a running  log  of  the  meeting  on  a separate  piece 
of  paper,  labeled  with  the  site,  group,  and  meeting  numbers  of  the  tape.  The  log 
will  take  the  place  of  "other"  cards,  and  is  also  to  provide  an  "index"  to  the  coded 
record,  so  that  the  ending  and  the  tape  can  be  matched  up  if  necessary  (e.g.,  for 
check-coding).  Each  tape  will  be  check-coded  on  the  segment  between  two  entries 
(usually  not  consecutive)  in  the  tape  log.  The  log  should  contain  at  least  three 
entries  from  each  deck  (from  002  on),  and  an  entry  for  each  problem-solving  unit  tha 
you  are  not  sure  how  to  code.  Each  entry  should  contain  the  card: column  location  of 
the  first  digit  of  the  coded  response  and  enough  of  the  speaker's  words  to  identify 
the  response  on  the  tape.  Indicate  whether  the  response  was  logged  because  of  codin 
difficulties.  If  the  meeting  runs  onto  the  second  side  of  the  tape,  enter  the 
card:column  location  of  the  first  response  from  the  second  side. 


70 


TWITS  I 'MAINTENANCE  INPUTS  . CONTENT  INPUTS 
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Decks  002-XXX 


Column 


15  SPEAKER 

1.  Resource  person 

2,  Supervisor 
1.  Group  member 

a,  General  response 

9.  Unidentifiable  speaker 


17-19  TYrjE  OF  INPUT 


RFnilF.ST 


10.  Er.posi  c i on 

15.  Progress  reporting 

3n.  Problem  definition  and  clarification 
31.  Problem  in  whose  control 


35.  Setting  priorities 


50. 
51  . 
52. 
5 3. 


Identifying  solutions 
Evaluating  solutions 
Active  choice  of  solutions 
Implementing  solutions 


FI'NCT  TONAL 


70.  Encouragement  of  participation 

71 . Reinforcement/accentance 

72.  Positive  perception 

73.  Agreement 

74.  Disagreement 

75.  Separation 

7 6.  Consensus  testing. 

77.  Conflict  resolution 

78.  Summarizing 

70.  Process  ronmerits/rbeckfng  accuracy 


-4 


43. 

90. 

47. 

98. 

49. 

00. 


Seeking  approval 

Evidence  of  misunderstanding 

Laughter 

M I s cel  1 ancons 

Uni n tell lgiblu/NA 


PROVISION 


20.  Exposition 

25.  Progress  reporting 

40.  Problem  definition  and  clarification 

41.  Problem  within  group's  control 

42.  Problem  outside  group's  con- 
trol 

43.  Tank-related  problem 

44.  Interpersonal  conflict  problem 

45.  Setting  priorities 

AO.  Identifying  solutions 

61.  Evaluating  solutions 

62.  Active  choice  of  solutions 

63.  Implementing  solutions 


DYSFIWCTIONAL 


82. 

Negative  perception 

83. 

Negative  response 

84. 

Non-productive  response 

85. 

Non-response  tn  leads 

86. 

Fragmented  discussion 

87. 

Suppress! on 
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Decks  002-XXX 


Guidelines  for  Input  Categories 
(see  also  detailed  definitions  on  following  pages) 

1.  Tn  ease  of  strong  doubts  regarding  statements  which  could  be  categorized  Into 
two  different  caterories,  use  the  following  preference  scheme: 

a.  Exposition  (highest  priority) 

b.  Problem  definition  and  clarification 

c.  Maintenance  and  miscellaneous  inputs  except  #72,  86  , 98,  and  99 

d.  Setting  priorities 

e.  Identifying  solutions 

f.  Evaluating  solutions 

g.  Active  choice  of  solutions 

h.  Implementing  solutions 

i.  Progress  reporting 

j.  Maintenance  inputs  #72,  86 

k.  Miscellaneous  inputs  #98,  99  (lowest  pirority) 

2.  When  coding  a statement  about  which  you  have  doubts,  keep  a log  with  the  following 
information  in  it: 

a.  The  group  number  and  the  group  meeting 

b.  The  exact  wording  of  the  statement 

c.  The  code  number  you  assigned 

d.  The  line  and  column  number  the  code  fell  in 

3.  Clarifying  or  background  information  frequently  accompanies  a request  for  a con- 
tent input.  If  it  is  impossible  to  understand  the  request  without  including 
the  background  information,  then  code  the  discourse  as  one  unit — i.e.,  request 
for  a particular  content  input.  If  this  request  can  be  understood  without  the 
background  information,  then  code  the  discourse  as  two  units — i.e.,  provision 

of  content  input  and  request  for  content  input. 

4 . Remember  to  use  categories  41-44  when  they  are  appropriate.  They  may  be  used 
instead  of  category  40  when  this  is  merited. 

5.  Exposition  emphasizes  content.  Maintenance  stresses  procedure. 

6.  When  the  speaker  is  providing  new  information,  do  not  categorize  the  statement 
as  summarizing. 

7.  Categorize  rhetorical  questions  (i.e.,  the  speaker  does  not  expect  a response) 
as  the  provision  of  an  input. 

8.  If  in  the  middle  of  an  input,  the  speaker  calls  on  another  individual,  code  the 
main  input  only  once  and  code  "the  calling  on  the  other  individual"  as  a separate 
input  at  the  end  of  the  main  input. 

9.  Tf  In  the  middle  of  a content  input  the  speaker  interrupts  himself  to  provide 
maintenance  inputs  other  than  just  calling  on  another  individual,  (1)  code  the 
input  occurring  befo.e  the  interruption,  (2)  code  the  interruption,  and  (3)  code 
the  input  occurring  after  the  interruption. 

10.  If  an  input  is  interrupted  by  another  speaker  and  then  completed,  code  the  input 
only  once. 

11.  Partial  comments,  interrupted  thoughts  or  confusion  caused  by  many  people  talking 
should  be  categorized  as  "Fragmented  Discussion,"  (86). 

If  discourse  is  fragmented  but  it  is  clear  from  the  context  which  input  occurred, 
do  not  code  tile  input  as  fragmented  discussion;  instead,  code  the  discourse  in 
the  appropriate  input  category.  The  coders  should  be.  reasonably  certain  from  the 
context  that  the  code,  is  correct. 


12. 
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Decks  00 2 -XXX 


INPUT  CATEGORIES -DETAI LED  DEFINITIONS 


I.  UNIT  OK  MEASUREMENT 

A.  PROBLEM— SOL V ING  INPUT : The  primary  unit  of  measurement  is  a 

problem-solving  input  provided  during  survey  data  feedback 
in  a work  group  meeting.  This  unit  is  based  upon  a single 
and  complete  content,  maintenance,  or  miscellaneous  input  as 
defined  in  the  categories  below,  regardless  or  time  required 
to  provide  the  input.  Every  time  a transition  to  a new 
speaker,  a new  unit  is  noted. 

SPEAKER:  Whenever  there  is  a shift  in  speakers,  a new  unit 

is  noted.  There  are  five  notations  for  speakers: 

1 = resource  person  speaking 

2 = supervisor  speaking 

3 = work  group  member  speaking 

4 = general  response 

9 = unidentifiable  person  speaking 
II.  INPUT  CATEGORIES 


Eight  categories  (10,15,30,35,50,51,52,53)  indicate  that  the 
speaker  is  requesting  that  a particular  content  input  be  pro- 
vided, Eight  parallel  categories  (20,25,40,45,00,61,62,63) 
indicate  that  the  speaker  is  actually  providing  the  particular 
content  input.  Categories  70-79  and  83-87  are  maintenance 
categories,  with  categories  70-79  representing  functional  inputs 
and  categories  83-87  representing  dysfunctional  inputs.  Categories 
95-99  are  miscellaneous  categories. 

„ . REQUEST  FOR  CONTENT  INPUTS 

10.  EXPOSITION : The  speaker  requests  statements  which  provide 

general  information  about  or  reactions  to  (a)  the  devel- 
opment effort,  survey  methodology,  or  meaning  of  the 
indices,  (b)  the  purpose  of  the  data  feedback  session(s), 
or  (c)  the  score  on  an  index  or  item. 

Kxs.:  "How  many  companies  are  included  in  the  national 

norm  file?" 

"What  are  we  supposed  to  do  during  this  feedback 
session ? 

"How  did  we  score  on  the  Human  Resources  Primacy 
index?" 
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15.  PROGRESS  REPORTING:  The  speaker  requests  statements 

which  provide  information  about  (a)  which  action  steps 
have  been  taken  to  solve  a problem  or  (b)  whether  the 
action  steps  taken  have  solved  the  problem  they  were 
intended  to  solve. 

Em;.:  "Wlwil  Inis  been  done  tin  (nr  In  g«-(  that  now  Innii 

app roved?" 

"Has  the  new  work  assignment  sheet  helped  to 
clarify  what  tasks  you  are  expected  to  complete 
each  week?" 

30.  PROBLEM  DEFINITION  AND  CLARIFICATION:  The  speaker 

requests  statements  which  (a)  identify  specific, 
concrete  problems  indicated  by  a particular  index 
or  item  score,  (b)  clarify  a previous  statement,  or 
(c)  provide  a concrete  example  of  a general  problem, 

Exs . : "What  specific  problems  with  our  work 

methods  were  you  thinking  of  when  you 
rated  this  item  low?" 

"When  you  said  'that  old  form,'  were  you 
referring  to  the  form  for  increasing 
coverage  for  a present  policy-holder?" 

"Can  you  give  me  a specific  example  of 
when  favoritism  was  shown?" 

31*  Problem  Within  Whose  Control  : The  sneaker  revests 

statements  which  identify  the  problem  as  one  which 
that  particular  work  group  can  solve  or  as  one 
which  another  group  or  department  must  solve. 

Ex.:  "Can  we  change  the  form  ourselves  without 

going  to  the  department  head?" 

33.  SETTING  PRIORITIES:  The  speaker  requests  statements 

which  indicate  the  order  in  which  the  problems  defined 
should  he  solved. 

Exs.:  "Which  problems  are  most  important  for  us  to 

solve  and  which  are  least  important?" 

"Which  problem  should  we  try  to  solve  first?" 

50.  1 PENT  I FY 1 NC  POSS 1 RLE  SOLUTIONS : Thu  speaker  requests 

statements  which  identify  possible  solutions  to  a 
problem  in  terms  of  the  concrete  steps  which  must  be 
taken . 

Ex.:  "What  would  we  have  to  change  in  order  to 

enlarge  your  job  so  that  you  will  have  more 
responsib i J i ty?" 
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51.  EVALUATING  PROPOSED  SOLUTIONS:  The  speaker  requests 

statements  which  evaluate  the  feasibility,  attractiveness, 
or  utility  of  the  suggestions  for  solving  a problem. 

Exs . : "What  are  the  pros  and  cons  of  this  suggestion?" 

"Which  of  these  proposed  solutions  do  you  think 
is  the  best  one?" 

52.  ACTIVE  CHOICE  OF  SOLUTION:  The  speaker  requests  statements 

which  indicate  which  of  the  proposed  solutions  will  be 
implemented . 

Exs,:  "Which  solution  should  we  go  with?" 

"Shall  we  try  Joe's  suggestion  then?" 

53.  IftPLEMENTING  THE  SOLUTION:  The  speaker  requests  statements 

which  identify  a particular  person  as  responsible  for 
taking  specific  action  steps. 

Exs.:  "What  exactly  needs  to  be  done  to  implement 

this  solution?" 

"Who  will  take  the  responsibility  for  making 
sure  these  things  get  done?" 


B.  PROVISION  OF  CONTENT  INPUTS 

20.  EXPOSITION:  The  speaker  makes  statements  which  provide 

general  information  about  or  reactions  to  (a)  the 
development  effort,  survey  methodology,  or  the  meaning 
of  indices,  (b)  the  purpose  of  the  data  feedback 
session(s),  or  (c)  the  score  on  an  index  or  item. 

Exs.:  "Over  24,000  people  have  completed  this  same 

survey. " 

"The  purpose  of  our  meetings  is  to  find  out  the 
survey  results,  to  identify  problems  indicated 
by  the  data;  and  to  solve  the  problems." 

"The  score  on  the  Decision-Making  Practices 
index  is  at  the  40th  percentile." 

25.  PROGRESS  REPORTING:  The  speaker  makes  statements  which 

provide  information  about  (a)  which  action  steps  have 
been  taken  to  solve  a problem  or  (b)  whether  the  action 
steps  taken  have  solved  the  problem  they  were  intended 
to  solve. 


Exs.:  "Since  our  last  meeting,  I have  developed  a 

draft  of  a form  for  dividing  our  work  up,  and 
this  week  I will  be  giving  all  of  you  copies 
to  react  to." 


PROBLEM  DEFINITION  AND  CLARIFICATION:  The  speaker  makes 

statements  which  (a)  identify  specific,  concrete  problems 
indicated  by  a particular  item  or  index  score,  (b)  clarify 
a previous  statement,  or  (c)  provide  a concrete  example 
of  a general  problem. 


Exs . : "I  think  the  low  score  on  the  Decision-Making 

Practices  index  reflects  the  fact  that  we  have 
no  say  in  deciding  what  days  we  have  off." 

"When  I said  'old  form'  1 meant  the  policy 
termination  form." 

"I  think  that  when  Mary  was  allowed  to  go  home 
sick  without  going  to  the  infirmary  first, 
favoritism  was  being  shown  for  her." 

41.  Problem  Within  Group's  Control:  The  speaker  makes 

statements  which  identify  the  problem  as  one  which 
that  particular  work  group  can  solve. 

Ex.:  "I  think  we  can  decide  ourselves  whether 

or  not  to  establish  a little  committee 
to  work  on  rearranging  our  work  area." 

42 . Problem  Outside  Group's  Control:  Speaker  makes 

statements  which  identify  the  problem  as  one 
which  someone  outside  that  particular  work  group 
must  solve  . 

Ex.:  "Restructuring  our  jobs  is  not  something 

that  we  can  do  ourselves." 


4'J,  Task-Related  Problem:  The  speaker  makes  statements 

indicating  that  the  problem  is  a task-related  one 
as  opposed  to  one  centering  around  interpersonal 
conflicts . 

Ex.:  "The  problem  around  here  is  that  there 

is  more  work  to  do  than  there  is  time 
to  do  it 


44.  Problem  Centers  Around  Interpersonal  Conflict:  The 

speaker  makes  statements  indicating  that  the  problem 
centers  around  interpersonal  conflict  as  opposed 
to  being  a very  task-related  problem. 

Ex. : "The  thing  that  bothers  me  most  about 

trying  to  establish  a liaison  with  the 
other  unit  is  that  I can't  stand  the 
secretary  over  there." 
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45.  SETTING  PRIORITIES:  The  speaker  makes  statements  which 

indicate  the  order  in  which  the  problems  defined  should 
be  solved. 

Exs.:  "These  problems  are  most  important  for  us  to 

solve  and  these  are  least  important." 

"I  think  we  should  try  to  solve  this  problem 
first." 

60.  IDENTIFYING  POSSIBLE  SOLUTIONS:  The  speaker  makes 

statements  which  itify  possible  solutions  to  a problem 
in  terms  of  the  concrete  steps  which  must  be  taken. 

Ex. : "if  we  want  to  re-arrange  our  work  area,  I think 

we  should  select  a small  committee  from  among  us 
which  will  find  out  what  allour  preferences  are, 
design  a floor  plan,  and  present  it  to  us  for 
suggestions  and  changes." 

61 • EVALUATING  PROPOSED  SOLUTIONS:  The  speaker  makes 

statements  which  evaluate  the  feasibility,  attractiveness, 
or  utility  of  the  suggestions  for  solving  a problem. 

Ex.:  "Using  work  assignment  sheets  would  help  to 

define  what  I'm  supposed  to  do  each  day,  but  it 
would  also  make  my  day  so  structured  that  I'd 
feel  hemmed  in." 

62.  ACTIVE  CHOICE  OF  SOLUTION:  The  speaker  makes  statements 

which  indicate  which  of  the  proposed  solutions  will  be 
implemented. 

Ex.:  "I  think  we  should  try  that  solution  to  the  problem." 

63.  IMPLEMENTING  THE  SOLUTION:  The  speaker  makes  statements 

which  identify  a particular  person  as  responsible  for 
taking  specific  action  steps. 

Ex.:  "If  we're  going  to  change  our  jobs  around,  first 

we  need  a list  of  all  the  various  tasks  all  of 
us  perform." 

"I  volunteer  to  work  on  developing  a new  form  for 
dividing  our  work  up  in  a flexible  way." 

"Why  don't  you  and  Mary  work  on  a floor  plan  for 
re-arranging  our  work  area." 
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C.  PROVISION  OF  MAINTENANCE  INPUTS 

Functional  Inputs: 

70.  ACTIVE  ENCOURAGEMENT  OF  PARTICIPATION:  The  speaker 

encourages  others  to  ask  questions,  offer  opinions, 
and  discuss  issues  by  explicitly  inviting  such  parti- 
cipation . 

Ex.:  "If  anyone  has  any  questions  about  this — or 

anything  else  we  cover  today — please  feel 
free  to  ask  them." 

71.  REINFORCEMENT /ACCEPTANCE : The  speaker  makes  state- 

ments which  indicate  that  the  individual  should 
continue  his  behavior  tough  not  necessarily  indicating 
agreement  with  content. 

Exs . : "Yeah." 

"Uh-huh." 

"Yeah,  yeah,  that’s  good"  (code  as  one  unit). 

"That's  a good  idea." 

"I  understand  what  you  mean." 

72.  POSITIVE  PERCEPTION  OF  OTHERS:  Speaker  makes  statements 

which  indicate  a positive  view  of  some  other  person(s)  . 

Use  this  category  only  when  the  unit  is  not  coded  as  a 
content  input. 

Ex.:  "I  like  you.  You're  a fun  person  to  be  with." 

73.  EXPRESSING  AGREEMENT:  The  speaker  makes  statements  which 

clearly  indicate  agreement  with  a statement  or  idea . 

Exs.:  "I  agree  with  that." 

"Yeah,  I think  you're  right." 

"I  feel  the  same  way  as  you  do  about  that." 

74.  EXPRESS! NG  DISAGREEMENT : The  speaker  makes  statements 

which  Indicate  disagreement  with  an  idea  or  statement . 

Exs.:  "I  don't  agree  with  that." 

"I  don't  think  that's  necessarily  true." 

7r>.  SEPARATING  IDEA-SEEKING  FROM  IDEA-EVALUATION:  The 

speaker  makes  statements  requesting  that  a problem  be 
defined  or  suggestions  for  solving  problems  be  presented 
without  anyone  evaluating  their  feasibility,  utility, 
or  attractiveness. 

Ex.:  "Eel's  hear  everyone's  ideas  about  this  before 

we  discuss  their  relative  merits." 

Best  Avsil&blB  Copy 
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76.  CONSENSUS -TESTING : The  speaker  requests  statements 

indicating  the  degree  of  agreement  with  an  issue  or 
decision . 

Exs . : "Do  all  of  you  see  the  staff  shortage  as  a 

problem?" 

"is  there  anyone  who  does  not  think  we 
should  work  on  solving  this  problem  first?" 

"Does  everyone  agree  that  this  solution  is 
the  best  one?" 

77.  CONFLICT  RESOLUTION:  The  speaker  makes  statements 

which  encourage  two  or  more  people  to  stop  disagreeing 
with  each  other  so  vehemently.  The  speaker's  state- 
ments indicate  that  he/she  is  seeking  the  source  of 
the  conflict  or  trying  to  resolve  it,  not  just  trying 
to  cool  it  out . 

Ex.:  "Let's  slow  down  for  a minute  and  make  sure 

each  of  you  understands  what  the  other  person 
is  saying." 

Do  not  include  comments  such  as  "Let's  not 
get  excited"  and  "Calm  down,  not."  Code 
comments  like  this  as  process  comments  (79) . 

78.  SUMMARIZING : The  speaker  makes  statements  reviewing 

the  discussion.  The  speaker  is  doing  more  than  para- 
phrasing another  speaker;  he/she  is  also  integrating 
previous  discussion. 

Ex.:  "So  what  has  been  said  os  far  is  that  oftentimes 
two  or  more  people  ask  you  to  do  work  for  them 
and  expect  it  to  be  done  quickly.  However,  you 
don't  know  whose  work  to  do  first  and  this 
creates  confusion  and  tension  for  you." 

79.  PROCESS  COMMENTS /CHECKING  ACCURACY:  The  speaker  makes 

statements  which  help  to  guide  the  discussion,  get  the 
group  hack  on  the  subject,  keep  the  group  focussed  on 
the  data,  or  check  the  accuracy  or  clarity  of  some 
statement  (speaker's  own  or  someone  else’s). 

Exs,:  "I  think  we’ve  gotten  off  the  track  We  were 

talking  about  problems  related  to  how  we 
work  together  as  a group." 

"Let 's  stay  focussed  on  problems  relevant  to 
item  97  in  the  Group  Process  index." 

"Let's  get  started  now." 

"Is  that  what  you  were  saying?" 

"Am  J understanding  you?" 

"Do  you  understand  what  I 'm  saying?"  ("Yes"  in 
answer  is  coded  as  reinforcement/acceptance-7J ) . 
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Disfunctional  Inputs: 

82.  NEGATIVE  PERCEPTION  OF  OTHERS:  Speaker  makes  statements 

which  indicate  a negative  view  of  some  other  person(s) . 

It  may  take  the  form  of  an  accusation.  Use  this  category 
only  when  the  unit  is  not  coded  as  a content  input. 

Ex.:  "I  can’t  stand  the  way  you  always  listen  to 

everything  that  Dale  and  I talk  about  in 
our  office."  (Code  82  if  this  statement  is 
not  the  main  statement  of  a problem.  If  it 
is  the  main  statement  of  a problem,  code 
as  44_  (interpersonal  conflict  problem)  . 

83.  NEGATIVE  RESPONSE:  The  speaker  indicates  an  inability 

or  unwillingness  to  respond  to  a request  or  perform  a 
task . 

Ex.:  "That's  not  my  problem." 

84.  NON-PRODUCTIVE  RESPONSE:  The  speaker  makes  irrelevant 

or  disruptive  statements. 

Exs . : "I'm  going  to  Hawaii  for  my  vacation  this  year." 

"Nothing  you've  said  has  made  any  sense  at  all." 

85.  NON-RESPONSE  TO  LEADS:  Period  of  silence  following  a 

question  or  request,  ended  by  (1)  speaker  clarifying 
lead,  or  (2)  same  or  different  speaker  going  off  in  a 
different  direction.  "Thinking  time"  of  short  duration 
(5  seconds  or  so)  should  not  be  coded  as  non-response. 

This  category  is  trying  to  pick  up  unwillingness  to 
respond,  or  inability  to  respond  because  of  the  nature 
of  the  question  or  request.  Code  speaker  as  "general 
response,"  unless  a specific  speaker  was  addressed. 

Then  code  the  speaker's  number  who  did  not  respond. 

Exs.:  "Well,  what  do  you  people  think  we  should  do 

about  this  problem?" (Coded  50) .. .Silence. . .Same  person, 
"Well,  do  you  think  it's  something  we  should 
just  let  go?"  (Now,  silence  coded  as  485)  . 

"Don't  you  think  it  might  help  if  we  improved 
our  training  procedures?"  (Probably  coded  as 
51)  ...Silence...  Different  person, "I  think  we 
should  have  more  paid  holidays."  , (Silence 
coded  as  485.  Statement  following  silence 
coded  as  40.) 

"Carol,  how  can  ve  help  you  to  plan  ahead  better?" 

(Carol  is  the  supervisor ).... Si lence .. . Supervisor 
says,  "Well,  whe.:  shall  we  schedule  our  next 
meeting."  (Silence  coded  as  285;  Statement 
following  silence  coded  279). 

Best  Available  Copy 
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'FRAGMENTED  DISCUSSION:  A period  which  cannot  be  categor- 

ized because  the  statement (s)  cannot  be  understood  or 
cannot  be  separated. 

Exs.:  "Ah,  well..." 

Several  people  speaking  at  once  about  different 
things. 

87.  SUPPRESSION;  The  speaker  makes  statements  which  inhibit 
or  squash  discussion  by  indicating  that  certain  topics 
are  not  to  be  discussed  because  of  his/her  personal  views. 

Ex.:  "I  don't  want  to  talk  about  that." 

"I  don't  want  that  talked  about  here." 

If  the  speaker  indicates  that  a topic  should 
not  be  discussed  at  a given  time  because 
it  would  mean  diverging  from  the  major  topic 
of  conversation,  do  not  code  as  suppression. 
Instead,  code  as  process  comment. 

D.  MISCELLANEOUS  INPUTS 

95.  SEEKING  APPROVAL;  The  speaker  requests  statements 
which  indicate  that  his  behavior  is  acceptable  to 
others . 

Ex.:  "Am  I wrong  to  want  to  be  respected?" 

96.  EVIDENCE  OF  MISUNDERSTANDING:  The  speaker  calls  attention 

to  a misunderstanding.  (Checking  understanding  should 

be  coded  as  a process  comment). 

Exs.:  "I  think  you  misunderstood  me." 

"I  don't  think  you  understood  what  she  said." 

"I  misunderstood  you." 

97.  LAUGHTER:  Laughter  which  interrupts  the  flow  of 

conversation. 

9b.  Ml  SCELI.ANEQUS : The  speaker  makes  statements  which  cannot 

be  classified  under  any  of  the  other  categories. 

99.  UN INTKLI.lt;  1 BLK/NA:  A statement  cannot  be  understood  because 
it  is  inaudible  or  drowned  out  by  non-human  background 
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Category  I : 
Included  Q: 

Category  II : 
Included  Q: 

Category  III: 
Included  Q: 


A Priori  Classification  of  SRS  Items 
Used  for  Establishing  Coder  Reliability 


Questions  that  i'equired  mental  summing  and  averaging 
of  observable  behaviors. 

2,  3.  5,  6,  7,  9,  10,  12,  13,  20,  21,  30,  31,  33,  38, 
39,  41 , 42,  44,  45,  46,  48  to  53. 


Questions  that  required  the  coders  to  make  judgements 
about  the  quality  of  a behavior  or  contribution. 

1,  8,  11,  14,  15,  22a,  22b,  22c,  22d,  25  to  29,  32, 
34,  35  to  37,  43,  47. 


Questions  that  required  the  coder  to  make  inferences 
about  the  attitudes  or  desires  of  group  participants. 

4,  16,  17,  18,  19,  40 
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APPENDIX  C 

COMPARISONS  OF  SUCCESSFUL  AND  UNSUCCESSFUL  GROUPS 
ON  DCS  AND  SRS  MEASURES 
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APPENDIX  C 


Mean  Of 

Unsuccessful  Groups 

Mean  Of 

Successful  Groups  Student's  t 

Level  Of 
Significance 

BCS  MEASURES 
I^tgTT) 

(N=6) 

N=5) 

RP  (PI) 

.55 

.63 

-1.09 

p<.  30 

Sup.  (PI) 

.49 

.55 

-.90 

p<. 39 

Grp.  (PI) 

.13 

.11 

.35 

pc. 73 

RP  (PS) 

.10 

.05 

1.39 

pc, 20 

Sup.  (PS) 

.04 

.05 

-.49 

pc. 64 

Grp.  (PS) 

.06 

.03 

1.13 

pc. 29 

Mtg.  (PS/C) 

.10 

.08 

.61 

pc. 55 

Mtg.  (C) 

.59 

.62 

-.86 

pc. 41 

RP  (FP) 

.10 

.14 

-1.78 

pc. 11 

Sup.  (FP) 

.14 

.12 

.54 

pc. 60 

Grp.  (FP) 

.04 

.03 

.25 

pc.  80 

Mtg.  (FP) 

.09 

.08 

.35 

pc.  74 

RP  ( DfP) 

.01 

.002 

1.29 

pc. 23 

Sup.  (DfP) 

.03 

.01 

1.54 

pc. 16 

Grp.  (DfP) 

.04 

.01 

1.92 

pc. 09 

Mtg.  (DfP) 

.06 

.04 

1.33 

pc. 22 

RP  (I) 

.39 

.34 

1 .00 

pc.  34 

Sup.  (I) 

.34 

.37 

-.63 

pc. 54 

Grp.  (I) 

.32 

.32 

-.05 

pc.  96 

RP  (D) 

.41 

.44 

-.31 

pc.  76 

Sup.  (D) 

.43 

.40 

.41 

pc.  69 

Grp.  (D) 

.55 

.53 

.35 

pc. 73 

RP  (Act.) 

.21 

.18 

.31 

pc.  76 

Sup.  (Act.) 

.35 

.36 

-.17 

pc.  87 

Grp.  (Act.) 

.46 

.45 

-.17 

pc.  87 

Mtg.  (Grp.) 

.07 

.07 

-.02 

pc. 98 

Mtg.  (S) 

.07 

.11 

-1.62 

pc. 14 

SR5  MEASURES 

(Mtg.  T)  (N=7)  (N=6) 


SRS  1 

3.00 

3.67 

-1.03 

pc.  32 

SRS  2 

3.14 

3.21 

-.08 

pc. 93 

SRS  3 

1.43 

1.75 

-.64 

pc. 54 

SRS  4 

1.62 

1.78 

-.43 

pc. 68 

SRS  5 

3.21 

3.28 

-.24 

pc.  81 

SRS  6 

2.00 

2.33 

-.65 

pc. 53 

SRS  7 

2.96 

2.96 

-.02 

pc. 99 

SRS  8 

2.64 

2.83 

-.59 

pc. 57 

SRS  9 

2.83 

3,19 

-.98 

p<,35 

SRS  10 

2.28 

2.58 

-.78 

pc.  45 

SRS  11 

1.19 

1.22 

-.05 

pc. 96 

SRS  12 

3.29 

3.08 

.50 

pc. 63 

SRS  13 

2.00 

2,33 

-.86 

pc. 41 
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Mean  Of 

Unsuccessful  Groups 

Mean  Of 

Successful  Groups 

Student's  t 

Level  Of 
Significance 

3RS  MEASURES 
(Mtg.  1 Cont.) 

(N=7) 

( N=6 ) 

Q3 

1.71 

1.50 

..48 

p<.64 

Q5 

3.86 

3.17 

.78 

pc. 45 

Q3 

3.57 

3.67 

-.19 

p< . 85 

Q12 

1.14 

1.17 

-.11 

p< . 9 1 

Q 1 6 

1.57 

1.67 

-.25 

p<.  80 

Q49 

2.00 

3.00 

-1.72 

pc. 11 

Q22a 

3.14 

3.00 

.22 

pc. 83 

Q22b 

2.86 

3.33 

-.75 

pc.  47 

Q22c 

1.57 

1.50 

.24 

pc.  82 

Q25 

1.14 

2.67 

-2.13 

pc. 06 

Q29 

2.00 

2.17 

-.45 

pc. 66 

Q41 

1.85 

1 .00 

-.45 

pc. 66 

oRS  MEASURES 

(Mtg.  2) 

(N=7) 

(N=4) 

SRS  1 

3.07 

3.00 

.13 

pc.  90 

SRS  2 

2.89 

3.56 

-1.02 

pc. 33 

SRS  3 

1.43 

1.75 

-.98 

pc.  35 

SRS  4 

1.57 

1.50 

.32 

pc.  76 

SRS  5 

3.35 

2.63 

1.86 

pc. 10 

SRS  6 

2.21 

3.00 

-1.19 

pc.  26 

SaS  7 

3.11 

2.31 

2.51 

pc. 03 

SRS  8 

2.93 

2.50 

.79 

pc.  45 

SRS  9 

2.83 

2.42 

.82 

pc.  43 

SRS  10 

2.7° 

3.00 

-.34 

pc. 74 

SRS  11 

1 .24 

.58 

.85 

pc.  42 

SRS  12 

3.00 

2.94 

.25 

pc. 81 

SRS  13 

2.36 

1.87 

.90 

pc.  39 

Q3 

1.43 

2.00 

-1.42 

pc. 19 

Q5 

3.29 

3.75 

-.64 

pc.  54 

Q8 

3.71 

3.75 

-.08 

pc. 93 

Q12 

1.43 

1 .25 

.54 

pc.  60 

Q16 

1.86 

1.75 

.40 

pc.  70 

Q49 

2.00 

2.00 

0 

1 ,00 

Q22a 

3.00 

2.75 

.33 

pc. 74 

Q22b 

2.71 

3.00 

-.50 

pc. 63 

Q22c 

1.57 

2.00 

-.66 

pc. 53 

Q25 

1.71 

2.00 

-.27 

pc.  79 

Q29 

2.00 

1.75 

.55 

pc.  60 

Q49 

1.85 

1.50 

.54 

pc.  60 

APPENDIX  D 


Sixteen  Indices  and  Component  Items 
From  The  Survey  of  Organizations 


Decision  Making  Practices 

A.  How  are  objectives  set  in  this  organization? 

1.  Objectives  are  announced  with  no  opportunity  to  raise 
questions  or  give  comments 

2..  Objectives  are  announced  and  explained,  and  an 
opportunity  is  then  given  to  ask  questions 

3.  Objectives  are  drawn  up,  but  are  discussed  with 
subordinates  and  sometimes  modified  before  being 
issued 

4.  Specific  alternative  objectives  are  drawn  up  by 
supervisors,  and  subordinates  are  asked  to  discuss 
them,  and  indicate  the  one  they  think  is  best 

5.  Problems  are  presented  to  those  persons  who  are 
involved,  and  the  objectives  felt  to  be  best  are  then 
set  by  the  subordinates  and  the  supervisor  jointly, 
by  group  participation  and  discussion 

B.  In  this  organization  to  what  extent  are  decisions  made  at 
those  levels  where  the  most  adequate  and  accurate  information 
is  available? 

C.  When  decisions  are  being  made,  to  what  extent  are  the  persons 
affected  asked  for  their  ideas? 

D.  People  at.  all  levels  of  an  organization  usually  have  know-how 
that  could  be  of  use  to  decision-makers.  To  what  extent  is 
information  widely  shared  in  this  organization  so  that 
those  who  male  decisions  have  access  to  all  available  kr  h. 
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Best  Available  Copy 
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II.  Hunan  Resources  Primacy 

A.  To  what  extent  does  this  organization  have  a real  interest 
in  the  welfare  and  happiness  of  those  who  work  here? 

B.  How  much  does  this  organization  try  to  improve  working 
condi ti ons? 

C.  To  what  extent  are  work  activities  sensibly  organized  in 
this  organization? 


III.  Technological  Readiness 

A.  To  what  extent  is  this  organization  generally  quick  to  use 
improved  work  methods? 

B.  To  what  extent  are  the  equipment  and  resources  you  have  to 
do  your  work  with  adequate,  efficient,  and  wel 1 -maintained? 


IV.  Lower  Level  Influence 

In  general,  how  much  say  or  influence  does  each  of  the  following 
groups  and  people  have  on  what  goes  on  in  your  department? 

A.  Lowest-level  supervisors  (foremen,  office  supervisors,  etc.) 

B.  employees  (people  who  have  no  subordinates) 


Communication  Flow 

A.  How  adequate  for  your  needs  is  the  amount  of  information 

you  get  about  what  is  going  on  in  other  departments  or  shifts? 

B.  How  receptive  are  those  above  you  to  your  ideas  and  suggestions? 

C.  To  what  extent  arc  you  told  what  you  need  to  know  to  do 
your-  job  in  the  best  possible  way? 
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VI.  Motivational  Conditions 

A.  How  are  differences  and  disagreements  between  units  or 

departments  handled  in  this  organization? 

1.  Disagreements  are  almost  always  avoided,  denieds 
or  suppressed 

2.  Disagreements  are  often  avoided,  denied,  or 
suppressed 

3.  Sometimes  disagreements  are  accepted  and  worked 
through;  sometimes  they  are  avoided  or  suppressed 

4.  Disagreements  are  usually  accepted  as  necessary  and 
desirable  and  worked  through 

5.  Disagreements  are  almost  always  accepted  as  necessary 
and  desirable  and  are  worked  through 

B.  Why  do  people  work  hard  iri  this  organization? 

1.  Just  to  Keep  their  jobs  and  avoid  being  chewed  out 

2.  To  keep  their  jobs  and  make  money 

3.  To  keep  their  jobs,  make  money,  and  seek  promotions 

4.  To  keep  their  jobs,  make  money,  seek  promotions,  and 

for  the  satisfaction  of  a job  well  done 

5.  To  keep  their  jobs,  make  money,  seek  promotions,  do 
a satisfying  job,  an_d  because  other  people  in  their 
work,  group  expect  it 

C.  To  what  extent  are  there  things  about  working  here  (people, 

policies,  or  conditions)  that  encourage  you  to  work  hard? 


Supe 
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VIII.  Supervisory  Goal  Emphasis 

A.  How  much  does  your  supervisor  encourage  people  to  give 
their  best  effort? 

B.  To  what  extent  does  your  supervisor  maintain  high  standards 
of  performance t 


IX,  Supervisory  Work  Facilitation 

A.  To  what  extent  does  your  supervisor  show  you  how  to  improve 
your  performance? 

B.  To  what  extent  does  your  supervisor  provide  the  help  you 
need  so  that  you  can  schedule  work  ahead  of  time? 

0.  To  what  extent  dees  your  supervisor  offer  new  ideas  for 
solving  job-related  problems? 


X.  Supervisory  Team  Building 

A.  To  what  extent  does  your  supervisor  encourage  the  persons 
who  work  for  him  to  work  as  a team? 

B.  lo  what  extent  does  your  supervisor  encourage  people  who  work 
for  him  to  exchange  opinions  and  ideas? 


XI ,  Peer  Support 

A.  How  friendly  and  easy  to  approach  are  the  persons  in  your 
work  group? 

8.  When  you  talk  with  persons  in  your  work  group,  to  what 
extent  do  they  pay  attention  to  what  you're  saying? 

C.  To  wh.it  extent  are  persons  in  your  work  group  willing  to 
listen  to  your  problems? 


XI  ] . Peer  Goal  Emphasis 

A.  How  much  do  persons  in  your  work  group  encourage  each  other 
to  give  their  best  effort? 

B.  lo  what  extent  do  persons  in  your  work  group  maintain  high 
standards  of  performance? 
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XIII.  Peer  Work  Facilitation 

A.  To  what  extent  do  persons 
ways  to  do  a better  job? 

B.  To  what  extent  do  persons 
help  you  need  so  that  you 
work  ahead  of  time? 


in  your  work  group  help  you  find 

in  your  work  group  provide  the 
can  plan,  organize,  and  schedule 


C.  To  what  extent  do  persons  in  your  work  group  offer  each 
other  new  ideas  for  solving  job-related  problems? 


XIV.  Peer  Interaction  Facilitation 

A.  How  much  do  persons  in  your  work  group  encourage  each  other 
to  work  as  a team? 

B.  How  much  do  persons  in  your  work  group  emphasize  a team 
goal? 

C.  To  what  extent  do  persons  in  your  work  group  exchange  opinions 
and  ideas? 


XV.  Group  Process 


A.  To  what  c-Atent  does  your  work  group  plan  together  and 
coordinate  its  efforts? 


B.  To  what  extent  does  your  work  group  make  good  decisions 
and  solve  problems  well? 


C. 


To  what  extent  is  information  about  important  events  and 
situations  shared  within  your  work  group? 


D.  To  what  extent  do  persons  in  your  work  group  know  what 
their  jobs  a^e  and  knew  how  to  do  them  well? 

L.  To  what,  extent  do  you  have  confidence  and  trust  in  the 
persons  in  your  work  group? 

I.  V)  what  extent  is  your  work  group  able  to  respond  to 
unusu.il  work  demands  placed  upon  it? 

b.  To  what  extent  does  your  work  group  real ly  want  to  meet 
its  objectives? 
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